-- Logs begin at Fri 2022-05-27 02:29:33 UTC, end at Fri 2022-05-27 04:00:07 UTC. -- May 27 03:16:36.907061 dv-cinder-843361-2-smb systemd[1]: Starting Devstack devstack@keystone.service... May 27 03:16:36.917001 dv-cinder-843361-2-smb devstack@keystone.service[80529]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 03:16:36 2022] *** May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: nodename: dv-cinder-843361-2-smb May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: machine: x86_64 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: clock source: unix May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: pcre jit disabled May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: detected number of CPU cores: 4 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: current working directory: / May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: detected binary path: /usr/bin/uwsgi-core May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: your processes number limit is 47680 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: your memory page size is 4096 bytes May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: detected max file descriptor number: 2048 May 27 03:16:36.919023 dv-cinder-843361-2-smb devstack@keystone.service[80529]: lock engine: pthread robust mutexes May 27 03:16:36.919745 dv-cinder-843361-2-smb devstack@keystone.service[80529]: thunder lock: enabled May 27 03:16:36.919745 dv-cinder-843361-2-smb devstack@keystone.service[80529]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 03:16:36.919745 dv-cinder-843361-2-smb devstack@keystone.service[80529]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 03:16:36.964644 dv-cinder-843361-2-smb devstack@keystone.service[80529]: Python main interpreter initialized at 0x556074f439c0 May 27 03:16:36.964644 dv-cinder-843361-2-smb devstack@keystone.service[80529]: python threads support enabled May 27 03:16:36.964644 dv-cinder-843361-2-smb devstack@keystone.service[80529]: your server socket listen backlog is limited to 100 connections May 27 03:16:36.964644 dv-cinder-843361-2-smb devstack@keystone.service[80529]: your mercy for graceful operations on workers is 90 seconds May 27 03:16:36.964995 dv-cinder-843361-2-smb devstack@keystone.service[80529]: mapped 403077 bytes (393 KB) for 2 cores May 27 03:16:36.965070 dv-cinder-843361-2-smb devstack@keystone.service[80529]: *** Operational MODE: preforking *** May 27 03:16:36.965354 dv-cinder-843361-2-smb devstack@keystone.service[80529]: *** uWSGI is running in multiple interpreter mode *** May 27 03:16:36.965354 dv-cinder-843361-2-smb devstack@keystone.service[80529]: spawned uWSGI master process (pid: 80529) May 27 03:16:36.965556 dv-cinder-843361-2-smb systemd[1]: Started Devstack devstack@keystone.service. May 27 03:16:36.966565 dv-cinder-843361-2-smb devstack@keystone.service[80529]: spawned uWSGI worker 1 (pid: 80540, cores: 1) May 27 03:16:36.966565 dv-cinder-843361-2-smb devstack@keystone.service[80529]: spawned uWSGI worker 2 (pid: 80541, cores: 1) May 27 03:16:36.967163 dv-cinder-843361-2-smb devstack@keystone.service[80529]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 03:16:42.715164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:16:42.715164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: from cryptography.utils import int_from_bytes May 27 03:16:42.715937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:16:42.715937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: from cryptography.utils import int_from_bytes May 27 03:16:42.730651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:16:42.730651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: from cryptography.utils import int_from_bytes May 27 03:16:42.731138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 03:16:42.731138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: from cryptography.utils import int_from_bytes May 27 03:16:42.765905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:16:42.766094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:16:42.766290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] command line args: [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:16:42.766560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:16:42.766739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ================================================================================ {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:16:42.767013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] admin_token = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.767260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] config_dir = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.767449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.767632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] config_source = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.767812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] debug = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.768018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.768511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.768594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.768804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.769052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.769301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.769485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_config_append = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.769663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.769893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_dir = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.770004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_file = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.770247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.770492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.770734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.770981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.771158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.771338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.771584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.771828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.772062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.772294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.772525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.772759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.773005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.773247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.773542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.774074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.774214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] publish_errors = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.774448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.774676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.774854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.775100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.775336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.775569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] standard_threads = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.775798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] use_journal = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] use_json = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] use_stderr = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.776911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] use_syslog = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.777140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.777422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.777662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.777923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.778170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.778418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.778658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.778867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 03:16:42.778954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.779065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 03:16:42.779151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.779263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] command line args: [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 03:16:42.779347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.779548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 03:16:42.779631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.779728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ================================================================================ {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 03:16:42.779817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.779983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] admin_token = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.780579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.780799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] config_dir = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.780893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.781034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.781154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.781466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.781545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] config_source = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.781677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] debug = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.781753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.781901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.782005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.782149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.782226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.782334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.782490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.782594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.782675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.782848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.782933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.783083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.783167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.783265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_config_append = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.783394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.783478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.783611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_dir = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.783696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.783790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_file = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.783873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.784041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.784125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.784294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.784379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.784536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.784613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.784773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.784850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.784952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.785030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.785131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.785271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.785401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.785502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.785651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.785737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.785889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.785973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.786125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.786202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.786361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.786440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.786598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.786675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.786847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.786924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.787093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.787171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.787329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.787413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.787559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.787789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.787943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.71/identity {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.788090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] publish_errors = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.788322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.788645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.788895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.788986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.789133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.789216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.789391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.789479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] standard_threads = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.789623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.789708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.789855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.789932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.790208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] use_journal = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.790400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] use_json = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] use_stderr = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.790714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] use_syslog = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.790799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.790948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 03:16:42.791026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.791918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.792950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.793883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.794880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.795923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.796543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.796719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.796844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.797938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.798992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.799935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.800854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.801970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.802932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.external = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.803948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.password = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] auth.token = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.804889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.805869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.806978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.807930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.808921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.809922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.810960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.811824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.812997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.813975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.814996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.815931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.816888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.external = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817651 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.817900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.password = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.818906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] auth.token = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.819988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.820955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.821925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.822951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.823918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.824876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.825836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.826820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.827987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.828997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.829836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.830866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.831987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.832961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.833923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.834991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.835966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.836973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.837957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] role.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] role.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.838994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.839970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.840989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.841925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.842004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.842163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.842322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.842402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.843927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.844929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.845888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.846877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.847981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.848933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.849927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.850947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.851903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.connection = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] role.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.852873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] role.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.853837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.854961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.855975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.856128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.856209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.856281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80541) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:16:42.856386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.856783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.857022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.857291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.857547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.857798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.858048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.858861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.859333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.859694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.859940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.860180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.860419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.860657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.860914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.861175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.861464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.861707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.861948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.862186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.862430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.862671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.862923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.863163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.863423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.863672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.863913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.864160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.864419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.864671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.864913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.865156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.865421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.865674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.865928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.866163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.866412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.866718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.866994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.connection = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.867246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.867495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.867736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.867979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.868216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.868456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.868694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.868933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.869178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.869512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.869760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.869998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.870248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.870486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.870733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.870965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.871206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.871441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 03:16:42.871614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 03:16:42.887794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.888032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.888265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.897680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.897779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.897921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.898155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.909992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.926557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.926786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.928853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.929088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.981191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:42.981828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.034138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.034320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.034855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.035096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.101996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.102129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.102214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.102345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.102429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.125872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.126992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.127076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.127209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.127294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.127429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.127647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.138875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.138997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.152969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.153869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80541) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 03:16:43.171905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.172110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:16:43.172451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.172550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.172656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:16:43.172738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:16:43.172934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 03:16:43.173482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.173988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.174240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.185542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.185816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.186158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.186519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.186687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.187114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.187390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.187676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.194802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.195815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.198089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.198365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.198646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.198924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.199219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.199981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.200945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.201167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.201466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.201743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.202641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.228916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.230517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.230687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.230966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.232251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.232532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.236244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.236518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.236793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.238211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.238491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.238773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.244214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.244495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.246086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.246368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.249524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.249921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.250203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.250483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.250757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.251030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.251300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.251565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.251686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.252059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.252346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.252628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.252901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.253176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.253480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.253750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.270184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.270461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.272619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.272899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.275063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.277605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.278701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.278993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.282250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.282548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.284811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.287708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.288409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.291353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.292177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.292484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.292766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.293056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.293370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.293653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.295144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.295444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.296358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.296860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.297246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.297567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.313498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.313777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.314041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.314301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.316970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.317275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.317545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.317810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.322274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.324058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.324335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.325869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.327514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.327904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.328031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.328184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.328307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.328465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.328741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.331282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.331565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.331847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.332134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.332412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.342388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.343197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.343667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.344062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.344348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.344632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.344907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.347096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.347379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.347663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.347950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.348229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.348500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.348788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.362956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.366238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.367298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.369555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.370585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.371152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.372780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.373065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.373374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.374543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.376437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.378105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.378398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.378687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.381313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.382913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.386203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.386401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.386530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.386783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.387060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.387813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.391462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.391756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.392044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.392362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.396187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.396847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.401621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.401906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.402294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.404729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80541) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.405550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.405826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.406114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.406371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.406638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.406921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.407189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.407465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.407736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.408003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.408262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.408531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.408793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80541) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.411009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 03:16:43.411289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.411569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.411844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.412114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.412385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.412658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.412941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.413211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.413515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.413805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.414067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.414329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.414593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 03:16:43.447973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556074f439c0 pid: 80541 (default app) May 27 03:16:43.451224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee562eb-6df0-4d4b-bd59-4941b8ad86ea None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:43.451515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee562eb-6df0-4d4b-bd59-4941b8ad86ea None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:43.451790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee562eb-6df0-4d4b-bd59-4941b8ad86ea None None] PATH_INFO: `/v3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:43.454665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556074f439c0 pid: 80540 (default app) May 27 03:16:43.456123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 791 bytes} [Fri May 27 03:16:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:16:52.298963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:52.299540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:52.299540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:52.304021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1/2] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:16:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:16:52.309406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:52.309846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:52.309946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:52.379964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: INFO dbcounter [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] Registered counter for database keystone May 27 03:16:52.401440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG oslo_db.sqlalchemy.engines [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80541) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:16:52.408024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writer thread running {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:16:52.587163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG passlib.handlers.bcrypt [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80541) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 03:16:52.587522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG passlib.handlers.bcrypt [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80541) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 03:16:52.643325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:52.644969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:52.775875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:16:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 27 03:16:52.939313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:53.007325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: INFO dbcounter [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] Registered counter for database keystone May 27 03:16:53.026496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG oslo_db.sqlalchemy.engines [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 03:16:53.033473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writer thread running {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 03:16:53.152124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973957be-2a6a-4c57-b62a-44e42243f9d1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:53.157175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:53.157860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:53.158147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:53.158422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:53.166527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:53.218433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING keystone.common.rbac_enforcer.enforcer [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 03:16:53.218713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbf32-0429-45ce-a865-4983ffcac96c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:53.228156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1324 bytes} [Fri May 27 03:16:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:16:53.234485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:53.249640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2cfca-4df7-4c08-a940-47fd100ac4cb None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:53.253985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:53.255080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:53.255363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:53.255643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] PATH_INFO: `/v3/projects/924e7efee14f4da6a43ace55813683f0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:53.257147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] RBAC: Authorizing `identity:get_project(project_id=924e7efee14f4da6a43ace55813683f0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:53.415895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING keystone.common.rbac_enforcer.enforcer [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 03:16:53.416548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b089c0-7edc-4456-809b-edd4003c47bf admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:53.421541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 3/5] 10.222.0.71 () {56 vars in 1207 bytes} [Fri May 27 03:16:53 2022] GET /identity/v3/projects/924e7efee14f4da6a43ace55813683f0 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:16:55.661861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed04dd-4060-457b-b7ef-a397d9a94a1d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.662387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed04dd-4060-457b-b7ef-a397d9a94a1d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.662534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed04dd-4060-457b-b7ef-a397d9a94a1d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.666529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 3/6] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:16:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:55.672077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.672447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.672636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.691064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:55.692565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:55.700182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:16:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 03:16:55.724012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed04dd-4060-457b-b7ef-a397d9a94a1d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:55.737653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed04dd-4060-457b-b7ef-a397d9a94a1d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:55.741799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:55.742431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.742721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.743001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.751187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:55.752962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344957-5565-4ac2-82fd-20e72dd81d60 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:55.761731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 4/8] 10.222.0.71 () {58 vars in 1324 bytes} [Fri May 27 03:16:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:16:55.767872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:55.776873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdbff4-4cdf-44ae-a84c-bdbf0f9cadfc None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:55.781846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:55.782711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:55.782996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:55.783273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:55.784723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:55.786578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee32824-97e0-4953-8d12-dda8e464a059 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:55.788130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 5/9] 10.222.0.71 () {56 vars in 1198 bytes} [Fri May 27 03:16:55 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:16:58.062142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a69d-7611-4eeb-b345-3bfdecd4ed96 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.062663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a69d-7611-4eeb-b345-3bfdecd4ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.062775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c001a69d-7611-4eeb-b345-3bfdecd4ed96 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.064051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 5/10] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:58.069152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.069560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.069889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.087355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:58.088521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:58.131027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c9a0-5813-4eb2-a097-03da3d58a5f5 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.131316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c9a0-5813-4eb2-a097-03da3d58a5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.131790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9c9a0-5813-4eb2-a097-03da3d58a5f5 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.133136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 6/11] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:16:58.138062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.138361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.139183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.167984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 6/12] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:16:58.179344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG passlib.handlers.bcrypt [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80540) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 03:16:58.179767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG passlib.handlers.bcrypt [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80540) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 03:16:58.191229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.216679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.229955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:16:58.231566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:16:58.299256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2860a-2767-45c8-8340-c845e30cac86 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.331973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 7/13] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:16:58.333002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.333926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.334540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.334886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.346637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:16:58.353898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:16:58.357881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:16:58.358789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:16:58.359703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 7/14] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:16:58.364729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.447706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.458568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b232ada-704c-41a4-84b6-c7a7a3cc0b00 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.461113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.466623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a9309-6e58-4164-bc0a-89916b89f929 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.496182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.497078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.497393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.497678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.501592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.502296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.502583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.502860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.503610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:16:58.503915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.505324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.518193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 8/15] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:16:58.523839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.569478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.571012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.625458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f1094-1d86-448f-ba8c-04a44068c8ac None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.659375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.660255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.660535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.660808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.662048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.663508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.665117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 9/16] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:16:58.670367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:16:58.671478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.675611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.678498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.685822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.771311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec3e5b-d4da-4129-8708-5a46fc834ffa None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.772952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef72bf6-a550-4067-b5e1-a363bc0e1544 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.804681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.805496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.805781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.806058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.807147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.807260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.807939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.808224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.808500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.808637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.810431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 10/18] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:16:58.815886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.828128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.829640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:16:58.850898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:16:58.851752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:16:58.852752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:16:58.852752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:16:58.852752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:16:58.852752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:16:58.852752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 9/19] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:16:58.857923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:16:58.896761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.914436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:16:58.915722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d906-9e66-4811-ab78-0f81f68990c0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:58.952010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:58.953019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:58.953340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:58.953620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:58.954493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.domain.id=default, user.id=52217d6a62f34512804d80cd8e1d71d9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:16:58.954812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:58.956326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364a9e4-a0b4-406b-9d90-8905b52e0111 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:58.964626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 11/20] 10.222.0.71 () {56 vars in 1322 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/role_assignments?user.id=52217d6a62f34512804d80cd8e1d71d9&scope.domain.id=default&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:16:59.074912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeee9e-82d4-4020-8d09-5ace3d3d698e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:16:59.111002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:16:59.111675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:16:59.111959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:16:59.112234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:16:59.112965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:16:59.113300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:16:59.114694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf1bb5-9dc5-4d64-8263-df3487d0dcb8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:16:59.133907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 10/21] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:01.462280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16690d6-e493-4984-a1cd-9a64ad266401 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:01.462809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16690d6-e493-4984-a1cd-9a64ad266401 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:01.462809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16690d6-e493-4984-a1cd-9a64ad266401 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:01.464195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 12/22] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:01.474172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8dbac-24f0-4d3e-83e8-7673a25b3816 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:01.475153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8dbac-24f0-4d3e-83e8-7673a25b3816 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:01.475656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8dbac-24f0-4d3e-83e8-7673a25b3816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:01.498931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bfb8dbac-24f0-4d3e-83e8-7673a25b3816 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:01.500520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bfb8dbac-24f0-4d3e-83e8-7673a25b3816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:01.594946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:01.636097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16690d6-e493-4984-a1cd-9a64ad266401 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:01.780743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30c4b-6176-43e7-aa50-462c043958cb None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:01.781078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30c4b-6176-43e7-aa50-462c043958cb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:01.781356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d30c4b-6176-43e7-aa50-462c043958cb None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:01.782904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 12/24] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:01.788038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:01.788333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:01.788611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:01.815877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:01.817105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:01.846122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16690d6-e493-4984-a1cd-9a64ad266401 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:01.901861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:01.910220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:01.911025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:01.911308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:01.911585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:01.931620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:01.940839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 13/25] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:01.941630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:01.942452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:01.943193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:01.945821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 13/26] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:01.953403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.022629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.034772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:02.155956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae6ba7-2f9a-4f83-a5bd-aec241d04c7c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.180577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c04a71-e69c-45f4-8f3c-a732fd76c6c5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.220550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.225296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c0531-3dbc-4c80-b098-f3fa0fa49957 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.230256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.231067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.231356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.231634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.247100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 14/27] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:02.249080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103eedb-4bc5-4437-8498-39a0ea810632 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.249514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103eedb-4bc5-4437-8498-39a0ea810632 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.249800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d103eedb-4bc5-4437-8498-39a0ea810632 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.251364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 15/28] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:02.254030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103eedb-4bc5-4437-8498-39a0ea810632 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.257038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.258546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-b0d8033b-0588-4ac8-aa75-7e079d9308a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:17:02.292414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:02.293243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:02.294074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:17:02.294074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:17:02.294074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:17:02.294074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:02.294293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 14/29] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:02.300482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.303518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.304547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.338309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:02.339609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:02.340810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:02.420341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:02.439116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d103eedb-4bc5-4437-8498-39a0ea810632 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.455729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 15/30] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:02.456678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.495221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.496891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.497466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.498108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.502465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.504309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.506453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 16/31] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:02 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:02.511752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.626286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bc3d28-a52a-47f4-a052-382dc933a457 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.640275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:02.662791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82213f9-5f41-418b-9e9f-44929a63131f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.665221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.666138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.666612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.667073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.668015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.670286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eb3bb1-5184-48bb-b795-bec9ed9bc7d6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.717746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.718435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.718712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.718986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.719708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:02.720010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.721813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.741226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 16/32] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:02.741987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.801941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:02.861639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f96a-5364-4a97-a743-9f496ca6e719 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:02.897634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 17/33] 10.222.0.71 () {60 vars in 1131 bytes} [Fri May 27 03:17:02 2022] POST /identity/v3/roles => generated 219 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:02.899352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea25ae6-085b-46a5-b810-cbaf6db661e1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.899616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea25ae6-085b-46a5-b810-cbaf6db661e1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.899900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea25ae6-085b-46a5-b810-cbaf6db661e1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.901442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 18/34] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:02.905451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea25ae6-085b-46a5-b810-cbaf6db661e1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:02.909218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:02.910275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.910773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.911269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.913917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:02.915664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0ec08-d675-4df9-99c1-cd0edc5f6ac9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:02.917610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 17/35] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:02.919185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:02.919877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:02.920364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:02.939659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:02.941375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:03.021406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 18/36] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:03.022689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:03.083236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:03.149661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6e5ab-33bc-486f-9b7c-89793476d535 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:03.169869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea25ae6-085b-46a5-b810-cbaf6db661e1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:03.189921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:03.191225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.191710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.192221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] PATH_INFO: `/v3/domains/default/users/52217d6a62f34512804d80cd8e1d71d9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.194663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=52217d6a62f34512804d80cd8e1d71d9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:03.196403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3693a90-6bb7-4b9c-845e-ec42698ad540 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:03.216274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:03.217715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.218008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.218290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.219127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:03.221143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:03.324890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 19/37] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:17:02 2022] POST /identity/v3/projects => generated 301 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:03.326862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:03.350983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:03.427626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 19/38] 10.222.0.71 () {58 vars in 1361 bytes} [Fri May 27 03:17:03 2022] PUT /identity/v3/domains/default/users/52217d6a62f34512804d80cd8e1d71d9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:03.429801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb6a5-d7f0-4154-9989-8d769edeecdd None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.430293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb6a5-d7f0-4154-9989-8d769edeecdd None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.430583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4bb6a5-d7f0-4154-9989-8d769edeecdd None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.436058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 20/39] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:03.439113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7715-fd9f-40a2-a7ac-17ca9392149e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.439113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7715-fd9f-40a2-a7ac-17ca9392149e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.439113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c7715-fd9f-40a2-a7ac-17ca9392149e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.439113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 21/40] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:03.444263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38299-635b-43c8-b580-5206426f843c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.444776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38299-635b-43c8-b580-5206426f843c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.445179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38299-635b-43c8-b580-5206426f843c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.463066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d974bc-4abf-4612-90c8-3e9dd7c1a29e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:03.471408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3fe38299-635b-43c8-b580-5206426f843c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:03.473250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3fe38299-635b-43c8-b580-5206426f843c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:03.524234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:03.525679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.526180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.526654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.527998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:03.530615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:03.566874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 22/41] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:03.568325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.568672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.568957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.592371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:03.593557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:03.608474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 20/42] 10.222.0.71 () {60 vars in 1131 bytes} [Fri May 27 03:17:03 2022] POST /identity/v3/roles => generated 225 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:03.609410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:03.634597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:03.693683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 23/43] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:03.721578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:03.730285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:03.755068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c04ba7-aa66-4ea8-83a2-49144cb75ada None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:03.803676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:03.804499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.804892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.805183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.805986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:03.807434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d902e7a-28d7-4753-a6fc-2ac4b005a819 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:03.850457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef38e80-aaa0-4a64-944c-80c39c0f16e3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:03.887343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:03.888157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:03.888485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:03.888764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:03.890008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:03.891596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:03.893245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 24/44] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:03.898868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:03.910181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 21/45] 10.222.0.71 () {60 vars in 1131 bytes} [Fri May 27 03:17:03 2022] POST /identity/v3/roles => generated 223 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:03.934382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:04.011915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62094e5-f6e2-4c03-bae9-21b34612dc51 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:04.048780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:04.049504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:04.049794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:04.050071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:04.050800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:04.052302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ef921-5114-41ef-933b-108f5244b30b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:04.137017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 25/46] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:17:03 2022] POST /identity/v3/projects => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:05.814968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0c1-939c-46c4-a016-7a174c10897d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:05.815477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0c1-939c-46c4-a016-7a174c10897d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:05.815477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0c1-939c-46c4-a016-7a174c10897d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:05.816818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 22/47] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:05.822122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:05.822504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:05.822692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:05.839669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:05.840845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:05.906533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 26/48] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:05.929866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c0c1-939c-46c4-a016-7a174c10897d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.029642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c0c1-939c-46c4-a016-7a174c10897d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.064399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.065244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.065506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.065783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.073440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.077913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:06.086956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:06.087863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:06.088777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 23/49] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:06.093973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.109903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.198211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5065d5c1-4c99-4f18-9d18-85062ea0e7e5 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.233605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.234274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.234558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.234836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.235584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:06.235891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.237293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860d96d-b6ac-4ff9-8f7d-91a35bd39619 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.245572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 27/50] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:06.251228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.350057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d839-e688-4257-80c5-3763002ebc1c None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.350269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d839-e688-4257-80c5-3763002ebc1c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.350549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820d839-e688-4257-80c5-3763002ebc1c None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.351930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 28/51] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:06.352064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262ae13-0a36-4220-ade7-cb0bad8340a9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.357118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.357565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.357843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.374025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:06.375245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:06.387739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.389118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.389444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.389720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.390916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.392362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.394098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 24/52] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:06 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:06.399512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.443756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 29/53] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:06.467611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.470754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.478731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.501736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b6f7-89a0-47a4-a963-b9b67aca49d9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.535388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.536192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.536488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.536770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.537980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.539468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.541039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 25/54] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:06.548521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.575065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983a8f5-d661-4bdc-b11a-1838580e06cf None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.611350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.612085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.612371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.612654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.613862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.615323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.617128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 30/55] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:06.622425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:06.652130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df1f54-c4c9-4fb9-aa87-47eda3e15077 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.687043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.687748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.688042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.688327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.689164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.domain.id=default, user.id=52217d6a62f34512804d80cd8e1d71d9) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:06.689512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.690987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e85c3-ae8b-4b8b-aa45-fb1cab1e5c20 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.693159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.698238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:06.701230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 26/56] 10.222.0.71 () {56 vars in 1322 bytes} [Fri May 27 03:17:06 2022] GET /identity/v3/role_assignments?user.id=52217d6a62f34512804d80cd8e1d71d9&scope.domain.id=default&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:06.724967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8502ef-2f36-4238-b8d5-9bda42b0c6af None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:06.762400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:06.763172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:06.763644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:06.763927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:06.764664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:06.766197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3e09-2e2c-4943-a24c-f9883bd6dc13 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:06.845673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 31/57] 10.222.0.71 () {60 vars in 1140 bytes} [Fri May 27 03:17:06 2022] POST /identity/v3/projects => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:09.060853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d118be-b632-41e8-97fb-6aa36318e877 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:09.061524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d118be-b632-41e8-97fb-6aa36318e877 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:09.061524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d118be-b632-41e8-97fb-6aa36318e877 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:09.062834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 27/58] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:09.068088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:09.068514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:09.068668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:09.086311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:09.087501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:09.153602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 32/59] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:09.178093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d118be-b632-41e8-97fb-6aa36318e877 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:09.275705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d118be-b632-41e8-97fb-6aa36318e877 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:09.308081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:09.308861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:09.309150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:09.309460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:09.311318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:09.312721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5dd3-08bc-4ec3-90a9-19da0bc96120 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:09.314326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 28/60] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:09.319695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:09.374838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:09.416527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c0acb-58c2-471b-ada6-5683f1ac6a44 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:09.451680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:09.452351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:09.452642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:09.452925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:09.453669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:09.455124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c272d234-143b-4519-a73c-5d1a2804162d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:09.574230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 33/61] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:09 2022] POST /identity/v3/users => generated 275 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:12.730829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131189e-2392-472d-81d0-8905177b15ce None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:12.732391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131189e-2392-472d-81d0-8905177b15ce None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:12.732864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131189e-2392-472d-81d0-8905177b15ce None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:12.734579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 29/62] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:12.739971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:12.740784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:12.741328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:12.761063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:12.762607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:12.858722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 34/63] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:12.894740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131189e-2392-472d-81d0-8905177b15ce None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:12.977841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.023042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131189e-2392-472d-81d0-8905177b15ce None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.068787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.069636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.069922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.070201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.084283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b4ee5c99-942c-4347-a070-0d55fe4cdb6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:13.092935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:13.093795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:13.094586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 30/64] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:13.099932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.163022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.164695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d7f4-e0cd-440f-b7fd-d6976f32b4a2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.165226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d7f4-e0cd-440f-b7fd-d6976f32b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.165739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2d7f4-e0cd-440f-b7fd-d6976f32b4a2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.167584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 31/65] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:13.173569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.174110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.174558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.202333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:13.204000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:13.271059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8bcc7-d7bf-4c3a-ad49-ebd3bd93da2d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.309206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.315607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.315900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.316188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.316957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:13.317285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:13.318760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:13.332121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 35/66] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:13.338262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.375714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 32/67] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:13.422424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.471970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59d7f3-85fe-47c4-b7fd-3fe45fdab76b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.479583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.493111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.507956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.508849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.509139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.509452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.525653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:13.527098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2309cc2-32a8-407a-8a96-ad3d80621679 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:13.529434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 36/68] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:13.530766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820e87-60c7-4e19-9174-345cab76d886 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.531079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820e87-60c7-4e19-9174-345cab76d886 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.531334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820e87-60c7-4e19-9174-345cab76d886 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.536987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 37/69] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:13.538250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203865e-81d8-4db9-a040-4c973d8e2096 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.538544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203865e-81d8-4db9-a040-4c973d8e2096 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.538827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5203865e-81d8-4db9-a040-4c973d8e2096 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.540224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 38/70] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:13.543366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203865e-81d8-4db9-a040-4c973d8e2096 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.557766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723c1a7-fe84-4e89-9e56-be55f5c90369 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.593652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.594453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.594740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.595021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.605654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e3ea62f1-3fac-4bb7-af7f-1964ca2aecff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:13.614187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:13.615091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:13.615854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 33/71] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:13.616596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c8b1-5aaf-40e9-850a-d85cfd76982b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.616839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c8b1-5aaf-40e9-850a-d85cfd76982b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.617118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088c8b1-5aaf-40e9-850a-d85cfd76982b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.633818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c088c8b1-5aaf-40e9-850a-d85cfd76982b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:13.635011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c088c8b1-5aaf-40e9-850a-d85cfd76982b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:13.667218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5203865e-81d8-4db9-a040-4c973d8e2096 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.700148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 34/72] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:13.701483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988532f7-8dc5-45d4-bffa-6f4e107a82c9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.701764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988532f7-8dc5-45d4-bffa-6f4e107a82c9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.702041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988532f7-8dc5-45d4-bffa-6f4e107a82c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.703517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.704192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.704507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.704768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.718202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-988532f7-8dc5-45d4-bffa-6f4e107a82c9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:13.719376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-988532f7-8dc5-45d4-bffa-6f4e107a82c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:13.740918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.762067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.779397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:13.780864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:13.784924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 35/73] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:13.786319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3172ec3-6a1f-4ddc-b4e3-35274ba63af9 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.786641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3172ec3-6a1f-4ddc-b4e3-35274ba63af9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.786893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3172ec3-6a1f-4ddc-b4e3-35274ba63af9 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.788154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 36/74] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:13.789993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3172ec3-6a1f-4ddc-b4e3-35274ba63af9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.893070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 39/75] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:13.893685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3172ec3-6a1f-4ddc-b4e3-35274ba63af9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:13.893943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:13.930436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:13.931114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.931404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.931689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.932435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:13.932748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:13.934177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634799f-fd27-4a58-b306-7c174b922dd3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:13.942981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 37/76] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:13.944191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:13.944487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:13.944772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:13.959224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.961665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:13.962853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:13.992134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:13.998836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1489a6-3ab8-436f-83a2-7fd4527670c7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.029931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 38/77] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:14.031240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.032605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.033445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.033732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.034009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.044317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:14.052056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:14.052887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 40/78] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:14.054053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.144523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248eb58-3ea3-4f84-bbcc-fc2d4b92a52f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.154859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5265a45-2879-454f-ba26-f74048c2634f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.177704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.179545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.180356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.180642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.180918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.188907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.189800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.194514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.194514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.194514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.194725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:14.194794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.194794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 41/79] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.195566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:14.200322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:14.201539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 39/80] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:14.207175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.231332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.294805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510fb50-5725-47cd-9d88-596512a32520 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.303737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9769ed-391f-40f3-96d2-efb9a71e3e97 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.327755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.328637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.328930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.329212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.330680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.331875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.333579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 42/81] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.334598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.339235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.340035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.340325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.340603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.342683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.344147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.345859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 40/82] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.346619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.392670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.433715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f256e-4d94-4ce3-9dbe-29f8b1feedc6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.441952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.447633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22b824-60b9-4ba8-8df0-4bfab2c8d7ca None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.467357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.468023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.468312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.468587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.469356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:14.469668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.471043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.479008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 43/83] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.479791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.482928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.483617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.483908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.484191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.485031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=245b589d4dce4345805725887ff002da, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:14.485389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.486837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.492711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 41/84] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.493437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.599000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296485e-76d1-47b7-a38a-23d850ec478e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.611845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838ad1c-95e4-41e5-9001-74e202a91706 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.622599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.640081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.640781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.641136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.641515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.642359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:14.642576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.643983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.650581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.651255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.651547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.651816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.657417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 44/85] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:14.658601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.691008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.737779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.739167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.766709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1be73-ca32-41a5-8cec-81c0b4bad130 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:14.802189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:14.803947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:14.804232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:14.804510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:14.805216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:14.806698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:14.847514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 42/86] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:14.848244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.893327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 45/87] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:14 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:14.893327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:14.927767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.944586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:14.979407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295d8a0-ab13-4446-adb7-6880d090245b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.016972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ccd6c-2cb1-4ba9-877d-615b6ddc93f5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.018172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.019150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.019529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.019886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.021223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.022837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.029564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 43/88] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:15.029564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.063605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.064642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.065005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.065410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.066781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.068610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.070270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 46/89] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:14 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:15.071214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.155237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf86d3de-d13c-479c-9511-18c2bd7167de None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.185139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.194942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.195953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.206081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.206081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.206081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.206081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.206406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08e7d6-3271-488e-90fd-4bc7d38ff0e8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.206480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 44/90] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:15.206480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.211780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.245897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.246963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.247527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.248007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.322442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7162aa-2aff-4b7f-b8b6-7a75345852fc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.345762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.347596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.366628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.367349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.367640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.367919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.441084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.449042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.451677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.517938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 47/91] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:15.518609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.550310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.564886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 45/92] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:15.566069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.707195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df7fda-4f46-4444-a530-4ee6af966b17 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.765703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.768112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3d08b-2fc1-4397-b84c-b8d98fcd5478 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:15.791079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.791747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.792030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.792309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.793150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=245b589d4dce4345805725887ff002da, user.id=52217d6a62f34512804d80cd8e1d71d9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:15.793508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.794997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.802978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 48/93] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/role_assignments?user.id=52217d6a62f34512804d80cd8e1d71d9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:15.805535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.841709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:15.843193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:15.843712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:15.844242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] PATH_INFO: `/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:15.845719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d15daf2574b93bf6beb57292bc2bb)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:15.847482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:15.853473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 46/94] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb => generated 312 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:15.857855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:15.960183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:15.994873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b7ec7-e41f-46c5-b9ff-ddbcb7fa5bbf None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:16.036465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:16.037783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:16.038274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:16.038768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:16.040249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:16.041951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:16.044489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 49/95] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:16.051248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:16.076111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d17a12-6cb7-4f98-a1d0-ed0674696156 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:16.179401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:16.180081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:16.180377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:16.180662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:16.181548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=9c0d15daf2574b93bf6beb57292bc2bb, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:16.181866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:16.183325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22739109-35cb-4092-9630-9a9aba589be5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:16.191882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 47/96] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:15 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=9c0d15daf2574b93bf6beb57292bc2bb&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 259 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:16.233408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e748-a856-4d06-bd99-c0b23d86438e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:16.280179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:16.280864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:16.281154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:16.281475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:16.282413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=245b589d4dce4345805725887ff002da, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:16.282733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:16.284338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd42e165-0a2e-4013-abd1-13a7c1ede582 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:16.293624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 50/97] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:16 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=5daf32e946ee47d98d2041330c41a624 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:17.148848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49c7-d4d8-4f11-a2d8-70081cbc0551 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.149477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49c7-d4d8-4f11-a2d8-70081cbc0551 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.149477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b49c7-d4d8-4f11-a2d8-70081cbc0551 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.151009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 48/98] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:17.157514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.157982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.158236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.169801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.190347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:17.192348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:17.299780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 51/99] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:17.345619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b49c7-d4d8-4f11-a2d8-70081cbc0551 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:17.383572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.479725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b49c7-d4d8-4f11-a2d8-70081cbc0551 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:17.527669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:17.529170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.529638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.529925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.548285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:17.557418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:17.558295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:17.559083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:17.561565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 49/100] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:17.567767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:17.688661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717470b-94e4-43b4-ac22-ada635932854 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:17.721747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.727344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:17.728030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.728321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.728602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.729478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:17.733735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:17.733735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:17.740237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 52/101] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:17.750400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:17.864563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:17.879806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b0b5-736e-4f65-b259-c4d1bd76bf00 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:17.925978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:17.926874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:17.927157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:17.927429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:17.928688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:17.930175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:17.931800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 50/102] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:17 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:17.938434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:18.087374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9adfe-b7a5-4d1f-8146-d227e4ae241e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:18.130227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:18.131572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.132115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.132626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.134409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:18.136328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a8d6f-3e56-4199-afd2-de49c80c9939 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:18.140020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 53/103] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:17 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:18.145473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:18.281107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bda473-0db3-46b4-a97a-a76db0b9e45b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:18.330851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:18.331754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.332038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.332312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.334599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, user_id=6b3fcf37bafd4606adaa01cb3322f5f9, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:18.336049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6c2c4-2442-4664-8fd0-27796ef86d3d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:18.374663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40cd5-5d7f-4173-ab94-278f6b63cbc2 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.375609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40cd5-5d7f-4173-ab94-278f6b63cbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.376142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f40cd5-5d7f-4173-ab94-278f6b63cbc2 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.377827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 54/104] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:18.383163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.383760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.384242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.408381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:18.410090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:18.438344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 51/105] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:18 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:18.449888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e649-947d-4c9b-b22b-26e5825b0c99 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.450911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e649-947d-4c9b-b22b-26e5825b0c99 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.451230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e649-947d-4c9b-b22b-26e5825b0c99 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.452506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 52/106] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:18.460104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.460104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.460104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.498143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:18.510878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:18.512005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:18.524323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 55/107] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:18.541676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:18.568604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:18.688310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 53/108] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:18.735719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:18.741945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a41b6-71e0-4c73-a7da-04b87d280243 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:18.816138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:18.816949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:18.817233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:18.817538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:18.818856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:18.820326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:18.823447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 56/109] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:18.830552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:18.927885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5c56b-6703-48d7-b702-8e53d53b4c32 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:18.949685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:19.000038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.000856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.001190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.001495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.016843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:19.024961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:19.025837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:19.026574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 54/110] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:19.033902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:19.036235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99b9a2-0e86-4302-9c49-8861f260a8b7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:19.045626 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:19.138541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.139215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.139496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.139774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.140499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:19.145280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:19.194615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8a0a7-4b7b-4c03-9b57-e2e591488790 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:19.244504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 57/111] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:17:18 2022] POST /identity/v3/projects => generated 302 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:19.261722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.262456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.262817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.263099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.263889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:19.264192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:19.265708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:19.278908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 55/112] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:19.285207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:19.444650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a9c76-41f8-4fde-b521-d61127c2e73c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:19.463111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:19.491214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.492111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.492397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.492673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] PATH_INFO: `/v3/users/b0f460ede9d54c3c81de50b5ebbab88e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.516064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f460ede9d54c3c81de50b5ebbab88e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:19.516064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795b8dd-69b2-497e-a39c-a03d1c0dbce2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:19.516064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 58/113] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:19 2022] GET /identity/v3/users/b0f460ede9d54c3c81de50b5ebbab88e => generated 289 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:19.524166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:19.585473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eec39f-d0f3-4b93-abc0-f4d2ab5397a1 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.585819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eec39f-d0f3-4b93-abc0-f4d2ab5397a1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.586038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eec39f-d0f3-4b93-abc0-f4d2ab5397a1 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.587615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 59/114] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:19.594715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764036d1-e498-45bc-8f34-7a06399ad822 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.595015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764036d1-e498-45bc-8f34-7a06399ad822 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.595284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764036d1-e498-45bc-8f34-7a06399ad822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.628220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-764036d1-e498-45bc-8f34-7a06399ad822 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:19.630539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-764036d1-e498-45bc-8f34-7a06399ad822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:19.654109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:19.693876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca6aa9-2018-4fe3-84fe-bc3b2a93e862 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:19.723204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 60/115] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:19.724786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2523b9-16f2-4c67-b653-913b9dc91868 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.725080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2523b9-16f2-4c67-b653-913b9dc91868 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.726249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2523b9-16f2-4c67-b653-913b9dc91868 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.727787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 61/116] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:19.739167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.739337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:19.739608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.739793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.739887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:19.740136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:19.740425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:19.759246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:19.760435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:19.837679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:19.839086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:19.850295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 62/117] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:19.851673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:19.911283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:19.965802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.032417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 56/118] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:20.033436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.051889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0a1bb-dbeb-43c7-ade9-ddf7a43ff557 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.143087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a9c94-999f-4b34-9f3f-debf3c3ff929 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.147603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.148708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.149233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.149731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.171384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:20.180336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:20.181219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:20.182000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:20.182593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 63/119] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:20.183362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.183955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.184787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.185060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.185366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.201515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fed0aa71-e568-4bed-8ed0-5e8110b7a3f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:20.209401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:20.210300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:20.211063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 57/120] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:20.212194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff757cf-94b2-453f-bdc6-a340c8fb9d41 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.213484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff757cf-94b2-453f-bdc6-a340c8fb9d41 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.217594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff757cf-94b2-453f-bdc6-a340c8fb9d41 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.219017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 58/121] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:20.219760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff757cf-94b2-453f-bdc6-a340c8fb9d41 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.258000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.315646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.328470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9ef50-1a1a-4266-b10c-50d141ffc6fa None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.340989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff757cf-94b2-453f-bdc6-a340c8fb9d41 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.372624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.373996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.374484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.375249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.376880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:20.379217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:20.386081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 64/122] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:20.387082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.387909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.389098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.389578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.389931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.390847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:20.391234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:20.393311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad15eca-99e8-4736-aeae-962588e143f9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:20.401959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 59/123] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:20.407160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.407160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.407160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.430237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:20.432475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:20.507093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0d918-823e-472c-b8dd-7337aab78b92 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.522503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 60/124] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:20.523681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.547481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.570428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.571068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.571355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.571632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.572394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:20.572701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:20.574245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:20.583730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 65/125] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:20.588881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.676036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.690772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c2f73-d73f-4a87-88c1-747692da7f30 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.727741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.728810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.729307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.729777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.730804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, scope.project.id=245b589d4dce4345805725887ff002da, user.id=b0f460ede9d54c3c81de50b5ebbab88e) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:20.732081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:20.733776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:20.740073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 61/126] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/role_assignments?user.id=b0f460ede9d54c3c81de50b5ebbab88e&scope.project.id=245b589d4dce4345805725887ff002da&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:20.741096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.781194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bbe2ae-4b46-4bc4-97bc-012a6c41f6d2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.837333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:20.848617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.849570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.849858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.850136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.853980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:20.855441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:20.858005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 66/127] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:20.858796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:20.863972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b06c4-bf1a-4a4a-8cb2-c9e2a3c93aca None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:20.905194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:20.906392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:20.906867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:20.907337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:20.920307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:20.928798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:20.929683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:20.930457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:20.932818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 62/128] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:20.933894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.049444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da192db7-0e48-47e9-bb61-1f638087cacd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.071424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:21.086246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c291f9-50dc-41c9-ad39-0966f5658a94 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.087961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.089069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.089601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.090134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.092036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.093734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.095656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 63/129] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:21.096613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.115845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:21.126454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.137910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 67/130] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:20 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:21.138351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.266258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63c800c-e23c-4d3d-899d-4850068dd600 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.332158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.333240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.333801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.334541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.335478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:21.336064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.337724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.343513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac42f2d-02c6-4456-95ad-e648867655bd None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.350146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 64/131] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:21.351233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.381405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.382303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.382588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.382864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.385317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, user_id=6b3fcf37bafd4606adaa01cb3322f5f9, role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.386769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.434268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:21.459273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a4f0e-e945-47b1-a393-2c7a9442ebcc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.491760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.492630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.492914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.493194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.494548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.496107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b221462-54b1-4ccb-9807-584a750f73fd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.498646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 65/132] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:21 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:21.505617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84abe-a2d2-4fb7-9d81-111cf5e5a538 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.505617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84abe-a2d2-4fb7-9d81-111cf5e5a538 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.505617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d84abe-a2d2-4fb7-9d81-111cf5e5a538 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.505885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 68/133] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:21 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/5daf32e946ee47d98d2041330c41a624 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:21.505958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 66/134] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:21.507693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.510178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84abe-a2d2-4fb7-9d81-111cf5e5a538 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.557527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:21.736677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05566558-2c15-4c4b-a5c3-4fa58cbb7d57 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.738497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d84abe-a2d2-4fb7-9d81-111cf5e5a538 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:21.783256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.783432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:21.784329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.784616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.784892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/users/52217d6a62f34512804d80cd8e1d71d9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.785201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.785848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.786420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.786988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, user_id=52217d6a62f34512804d80cd8e1d71d9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.788056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:21.788504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.789966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cef1e2-568a-40ca-85a4-0fe10a942ab5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:21.792414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 69/135] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:21 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:21.794070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:21.794676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:21.795027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:21.812823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:21.814141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:21.868503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 67/136] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:21 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/users/52217d6a62f34512804d80cd8e1d71d9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:21.873882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:21.877644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:21.950808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 70/137] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:22.004930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.029539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:22.094059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae11ac-cbb1-4c63-8e4b-3994706af489 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.146479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.147815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.148315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.148811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] PATH_INFO: `/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.149221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35931f1e-8a80-4f68-82ab-c68f6fbd1e38 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.150761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d15daf2574b93bf6beb57292bc2bb)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.152786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c29f1f-6da5-42ec-8571-bad60e8089be None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.156005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 68/138] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:21 2022] GET /identity/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb => generated 312 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:22.161856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e58d8-a725-4e4d-8e5c-d5cf49479369 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.162456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e58d8-a725-4e4d-8e5c-d5cf49479369 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.162983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e58d8-a725-4e4d-8e5c-d5cf49479369 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.164595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 69/139] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:22.169801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e58d8-a725-4e4d-8e5c-d5cf49479369 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.192741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.193595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.193882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.194159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.217131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a214f3eb-3c82-47c9-9b0f-9d5e4f7a8f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:22.236266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:22.237236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:22.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:22.245830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 71/140] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:22.248576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.249688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.249978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.276387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:22.277950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:22.298078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:22.339359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e58d8-a725-4e4d-8e5c-d5cf49479369 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.359924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 72/141] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:22.361117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.370707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:22.380565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.381496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.381785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.382061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] PATH_INFO: `/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.384470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0d15daf2574b93bf6beb57292bc2bb, user_id=6b3fcf37bafd4606adaa01cb3322f5f9, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.386590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.464422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 70/142] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:22 2022] PUT /identity/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb/users/6b3fcf37bafd4606adaa01cb3322f5f9/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:22.465185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.526783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad56761-bf78-4871-b798-7f01610cc18d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.594768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.595470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.595757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.596037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.596804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:22.597171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.598663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.619837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 73/143] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:22.638859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.677026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb88a7-3682-4a9b-bc33-cf99a04d96d9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.718100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:22.729056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.729912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.730196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.736802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.736802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.736802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.743093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 71/144] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:22.746411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.800444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:22.827989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf62278-f901-4bd3-a552-8b5780193c3e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:22.867365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:22.868775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:22.869066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:22.869453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:22.870823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:22.873002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:22.874742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 74/145] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:22.880420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:22.990187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266f4a1-2cde-410b-9eb3-49a80037ac86 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:23.051729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:23.052415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.052703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.053028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.054061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:23.055674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:23.068608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf6671d-ca4f-4076-a08f-9815a72f604f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:23.118284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:23.118942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.119224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.119498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.124129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:23.173043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 72/146] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:22 2022] POST /identity/v3/users => generated 283 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:23.212409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:23.213943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:23.347032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 75/147] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:17:23.352811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:23.432606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:23.483226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061f26-0023-4b14-9044-28bc25e047d5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:23.518406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:23.519280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.519568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.519847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.522852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:23.522852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b81a3-baed-44b8-9c22-7ef44fd6ed24 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:23.524474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 73/148] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:23 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:23.530220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:23.578232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:23.670836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31df0b4-284e-4352-baa3-6400679d1d78 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:23.719902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:23.720486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.720773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.721053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.721924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=245b589d4dce4345805725887ff002da, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:23.722242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:23.723722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ce19-fbce-4864-94fc-6d7e166190cf None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:23.734202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 76/149] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:23 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:23.806975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8d87-7d74-4bfb-b225-dcefd4b121f8 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.807951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8d87-7d74-4bfb-b225-dcefd4b121f8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.808454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8d87-7d74-4bfb-b225-dcefd4b121f8 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.810186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 74/150] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:23.816095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:23.816383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:23.816665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:23.834795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:23.836321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:23.916678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 77/151] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:23.953059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8d87-7d74-4bfb-b225-dcefd4b121f8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.079376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8d87-7d74-4bfb-b225-dcefd4b121f8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.105789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:24.120173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.122975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.122975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.122975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.136278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:24.145096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:24.146015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:24.146775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:24.149899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 75/152] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:24.156555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.186339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:24.274749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6a1b0-37fa-4296-9168-5d66c770a642 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.311993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.312678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.312963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.313238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.314097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:24.314404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:24.315908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0bd6c-30d1-4777-a9cf-78ed69653dc1 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:24.325608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 78/153] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:24.331593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.463239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05748920-ee3a-41d7-9123-a91dbd184e27 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.493400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb86-b873-4839-a6d3-d046d34dd686 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.494044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb86-b873-4839-a6d3-d046d34dd686 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.494542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbeb86-b873-4839-a6d3-d046d34dd686 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.496118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 79/154] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:24.502157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.502695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.503241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.508358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.509620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.509620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.509896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] PATH_INFO: `/v3/users/b0f460ede9d54c3c81de50b5ebbab88e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.511089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] RBAC: Authorizing `identity:get_user(user_id=b0f460ede9d54c3c81de50b5ebbab88e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:24.512759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:24.514892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 76/155] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:24 2022] GET /identity/v3/users/b0f460ede9d54c3c81de50b5ebbab88e => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:24.522379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.530272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:24.537182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:24.609778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:24.675690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 80/156] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:24.690801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a20a9-ad50-48b4-88c1-66714d45a2fb None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.734979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.737148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.740444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.740980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.745930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.750425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:24.753122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:24.758303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 77/157] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:24 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:24.762780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:24.778598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:24.917236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef381f-ac35-4e4d-9595-ee869d88fc5e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.934571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3606a87-6619-41f6-848a-238c8e4561c5 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:24.941148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:24.977731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.978638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.978921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.979197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/users/b0f460ede9d54c3c81de50b5ebbab88e/roles/1ea8ae00b320441b9e0c1b4a9d2d7102` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:24.982445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, user_id=b0f460ede9d54c3c81de50b5ebbab88e, role_id=1ea8ae00b320441b9e0c1b4a9d2d7102)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:24.983905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db324f2f-6e7b-4e2a-b96c-58bb9381451b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:24.993875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:24.994746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:24.995041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:24.995305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.007941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:25.021365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:25.022348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:25.023206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 81/158] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:25.029566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.084950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 78/159] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:24 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/users/b0f460ede9d54c3c81de50b5ebbab88e/roles/1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:25.089621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ebb7-ba2d-4db3-b008-d18c36fbbf14 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.089953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ebb7-ba2d-4db3-b008-d18c36fbbf14 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.090290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00ebb7-ba2d-4db3-b008-d18c36fbbf14 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.092183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 79/160] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:25.114565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.114874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.115142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.141713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:25.146510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:25.147744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:25.164688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15bfc74-3664-43a1-bded-e467f14b4cc9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:25.205848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:25.207022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.207503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.207969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.209589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:25.210143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:25.211930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:25.222597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 82/161] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:25.227755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.319408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 80/162] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:25.342683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d61316-6ab7-482a-b025-ccf88ef278a8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:25.370337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.381947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:25.383247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.383782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.384268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.386361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:25.388239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:25.390261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 83/163] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:25.397046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.417634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:25.518565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f7c51-a74e-47f8-b7d7-2fef0cf1f19c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:25.578041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:25.578805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.579297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.579580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.609999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a27e24-3c42-455a-b09a-972adcc93f7a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:25.627112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:25.656046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:25.656868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.657158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.657698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.670806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:25.685110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:25.686178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:25.687048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 81/164] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:25.698180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.750397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:25.752159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:25.771290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:25.848314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4819d2-a311-4df1-9da2-859453b43318 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:25.916213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:25.916905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:25.917192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:25.917499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:25.923707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:25.924082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:25.925575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:25.944315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 82/165] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:25.950404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:25.975670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 84/166] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:25.982701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:26.008219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:26.101015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12198d1b-2cfb-46dd-a5c0-05f174697a49 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:26.143009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:26.143961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.144297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.144593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] PATH_INFO: `/v3/users/52217d6a62f34512804d80cd8e1d71d9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.146529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] RBAC: Authorizing `identity:get_user(user_id=52217d6a62f34512804d80cd8e1d71d9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:26.148282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:26.150668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 83/167] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/users/52217d6a62f34512804d80cd8e1d71d9 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:26.161505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:26.209325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d90750-3a99-4ff6-bb41-a97746943649 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:26.227722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:26.276891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:26.278328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.278753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.279263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.280717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:26.282216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:26.283935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 85/168] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:25 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:26.290860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:26.323717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:26.333492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc545a-d5a6-40f6-bb8e-225745ec48d0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:26.405334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:26.406457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.406944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.407418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.448192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5a42a-3ef3-4950-8377-c86ce716b4f5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:26.488119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:26.488778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.489062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.489371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.490290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=245b589d4dce4345805725887ff002da, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:26.490604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:26.492124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:26.499029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 86/169] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:26 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=5daf32e946ee47d98d2041330c41a624 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:26.576571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:26.578625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bf97d-3d0e-4eab-8dd3-b461e1dd3dc7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:26.712891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:26.719540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 84/170] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:17:26.724421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:26.761439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250d4b-71da-43d5-b3f0-979a10bc2999 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.761737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250d4b-71da-43d5-b3f0-979a10bc2999 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.762035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64250d4b-71da-43d5-b3f0-979a10bc2999 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.764003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 85/171] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:26.769057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.769384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.769665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.787226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:26.799339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:26.800543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:26.852630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef6905f-d22f-43a1-97d8-55001345ad04 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:26.895300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:26.896243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:26.896528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:26.896804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:26.902091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:26.904179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:26.906225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 87/172] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:26 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:26.912202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:26.928718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 86/173] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:26.964625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:27.060678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7649f3-af00-4ecd-8ac8-580a3edce2be None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:27.097577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:27.098284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.098574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.098856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.099693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=245b589d4dce4345805725887ff002da, user.id=52217d6a62f34512804d80cd8e1d71d9) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:27.100004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:27.101476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:27.109663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:27.114342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 88/174] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:26 2022] GET /identity/v3/role_assignments?user.id=52217d6a62f34512804d80cd8e1d71d9&scope.project.id=245b589d4dce4345805725887ff002da&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:27.150087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85eadf-05fe-46f9-acac-d0424f90c358 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:27.193639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:27.206363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:27.207588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.207999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.208377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.227507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:27.242193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:27.243166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:27.243967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 87/175] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:27.249590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:27.397971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e149f-5886-4837-96ca-0be555f8abdd None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:27.442683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:27.443357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.443638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.443915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.444668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:27.444973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:27.446383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:27.464084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 89/176] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:27.470126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:27.610467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea2b5fa-5ed3-456b-87ec-174d87aac6a2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:27.659861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:27.660743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.661025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.661319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] PATH_INFO: `/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.662516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] RBAC: Authorizing `identity:get_user(user_id=6b3fcf37bafd4606adaa01cb3322f5f9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:27.663974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5633e3-3361-44d0-aa3f-2bfac53aff63 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:27.665636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 88/177] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:27 2022] GET /identity/v3/users/6b3fcf37bafd4606adaa01cb3322f5f9 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:27.671813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:27.729297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:27.817173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bcab5-371a-4fd3-b282-da01133295a7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:27.864588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:27.865247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.865553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.865831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.964737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:27.966849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:27.970134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d957e-ca12-4668-a7b5-ca7b59f2d391 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.970597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d957e-ca12-4668-a7b5-ca7b59f2d391 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.970691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d957e-ca12-4668-a7b5-ca7b59f2d391 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:27.972415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 89/178] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:27.978407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:27.978704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:27.978963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.004061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:28.005306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:28.033501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.083055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.113891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 90/179] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:28.143023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 90/180] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:28.148593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.158511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.280522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a516072-bbb3-4e15-a086-3459bf8ce638 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.294378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06f160-d94f-4d71-ae53-da12900f00ce None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.321893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.322850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.323201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.323549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.328197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.337941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:28.345566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-cd0be5e5-777f-4fcc-992b-1c4fbc8dae40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:28.345974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:28.346820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:28.347627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 91/181] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:28.349051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88153c4-828c-4726-9af7-07b21c0e64b0 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.349602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88153c4-828c-4726-9af7-07b21c0e64b0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.349979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88153c4-828c-4726-9af7-07b21c0e64b0 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.350133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.350550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.350967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] PATH_INFO: `/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.351815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 92/182] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:28.352725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d15daf2574b93bf6beb57292bc2bb)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:28.354715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9654307-7283-4681-909e-fe378d3e9318 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:28.356625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88153c4-828c-4726-9af7-07b21c0e64b0 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.357156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 91/183] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/projects/9c0d15daf2574b93bf6beb57292bc2bb => generated 312 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:28.358429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.358720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.359001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.382461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:28.383960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:28.443769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.466897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 92/184] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:28.474281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.493718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88153c4-828c-4726-9af7-07b21c0e64b0 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.538841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.539518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.539807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.540089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.540837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:28.541145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:28.542568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:28.554929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 93/185] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:28.556361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.607990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87d6b3-88bb-4d2c-b66f-3e2290689659 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.689661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.698655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.699314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.699639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.699903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.700779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=9c0d15daf2574b93bf6beb57292bc2bb, user.id=6b3fcf37bafd4606adaa01cb3322f5f9) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:28.701048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:28.702527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf50421e-81c7-4219-83d6-1ee33de28845 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:28.709377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 93/186] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/role_assignments?user.id=6b3fcf37bafd4606adaa01cb3322f5f9&scope.project.id=9c0d15daf2574b93bf6beb57292bc2bb&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:28.710830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837b5f-e091-47c5-a0a0-f1bf0f0b4b67 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.711121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837b5f-e091-47c5-a0a0-f1bf0f0b4b67 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.711395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43837b5f-e091-47c5-a0a0-f1bf0f0b4b67 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.712998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 94/187] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:28.718440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837b5f-e091-47c5-a0a0-f1bf0f0b4b67 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.748510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf07db9-f19c-44ff-bd40-e57d4d549052 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.790021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:28.807886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.808718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.809163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.809459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.829794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3058e4d2-1d18-4f5b-b1b0-abfd43367f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:28.840167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:28.841326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:28.842131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 94/188] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:28.843553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d598b5-777f-4c19-a88a-38450c150ebb None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.843553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d598b5-777f-4c19-a88a-38450c150ebb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.843553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d598b5-777f-4c19-a88a-38450c150ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.862669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b9d598b5-777f-4c19-a88a-38450c150ebb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:28.863293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43837b5f-e091-47c5-a0a0-f1bf0f0b4b67 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:28.863777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b9d598b5-777f-4c19-a88a-38450c150ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:28.917122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:28.918040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.919003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.919243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.936161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:28.937670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:28.939431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 95/189] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:28.940200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:28.941928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 95/190] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:28.943399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03ce8e-7011-4e6f-b673-6613e5a8d0a0 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.943710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03ce8e-7011-4e6f-b673-6613e5a8d0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.943986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03ce8e-7011-4e6f-b673-6613e5a8d0a0 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.945267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 96/191] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:28.951243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:28.951541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:28.951820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:28.972881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:28.974087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:29.023929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.048261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 97/192] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:29.057451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.057682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65334ce0-1838-4eb1-b525-7ccc567ca15f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.065502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.092909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.093887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.094210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.094640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.095434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:29.096063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.097480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.105518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 96/193] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.107217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.156064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1959b6-7a55-4ecb-8844-d16b9686c8e8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.189716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.190358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.190638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.190909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.204811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07c2a1-4529-4901-a6a3-a6df7434e278 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.237132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.239142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.239936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.240218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.240502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.241692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.246341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.246341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 97/194] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.246341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.258927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.260405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.283239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.346164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69022e0e-78fd-4fab-9bad-d0f4f000d4a8 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.359256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 98/195] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:29.360103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.380143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.380940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.381227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.381532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.392026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:29.399772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:29.400702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:29.401537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 98/196] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:29.402325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.439330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.460947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b5295-8cc1-464a-87a9-51780b4749f4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.495693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.496882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.497176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.497490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.497634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.498717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.500158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.502004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 99/197] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.502583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.503350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e507e1-88f9-4523-9f64-c09464594611 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.541094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.541813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.542100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.542379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.543674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.545575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.615627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb84146-0644-4ed0-abbd-bd47c9ed0a68 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.648099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.648942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.649222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.649522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.650672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.652103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.654389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 100/198] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.655138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.669481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.705375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 99/199] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:29 2022] POST /identity/v3/users => generated 297 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:29.705375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.756184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691f0edf-7563-438d-a409-5a55171056e4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.795998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.797048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.797681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.797964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.798738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:29.799166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.800646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.810878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 101/200] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.811646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:29.827793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5d85b-0955-4cf9-92c1-bc7bf5cdfa8f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.864016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.864692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.864977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.865284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.889906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.903882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:29.927622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a79e0-ea96-45f7-9072-b159a49cca61 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:29.952967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.954805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.968424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:29.969166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:29.969590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:29.969861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:29.970744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=14c287dc5f034438897143cac143be29) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:29.971055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:29.972509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:29.978489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 102/201] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/role_assignments?user.id=14c287dc5f034438897143cac143be29&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:29.979290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:30.095200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 100/202] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:30.100271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:30.129646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4301e-11a9-4e5e-b703-9b87248142e7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:30.174321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:30.175554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:30.176019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:30.176468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] PATH_INFO: `/v3/users/b0f460ede9d54c3c81de50b5ebbab88e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:30.177945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] RBAC: Authorizing `identity:get_user(user_id=b0f460ede9d54c3c81de50b5ebbab88e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:30.179606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:30.181540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 103/203] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:29 2022] GET /identity/v3/users/b0f460ede9d54c3c81de50b5ebbab88e => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:30.185647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:30.188161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:30.202025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:30.229782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854423dc-5415-44e2-a6b5-25657a309b51 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:30.272945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:30.274238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:30.274706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:30.275185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:30.276657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:30.278431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:30.280382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 101/204] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:30 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:30.290207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:30.329972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d9ad3-0c98-43c4-880e-b2fb5374a762 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:30.407097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:30.407821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:30.408158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:30.408440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:30.451387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df46a77-9ff9-4748-beea-b34be73f26c0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:30.472676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:30.487874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:30.488455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:30.488736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:30.489007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:30.490381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=14c287dc5f034438897143cac143be29) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:30.490696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:30.492127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:30.499164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 102/205] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:30 2022] GET /identity/v3/role_assignments?user.id=14c287dc5f034438897143cac143be29&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=5daf32e946ee47d98d2041330c41a624 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:30.549473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:30.551309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:30.567050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:30.747319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 104/206] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:30.754597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:30.885624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e54e-b9bd-411f-9d8a-ef928bcc562f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:30.921655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:30.922886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:30.923416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:30.923881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:30.925279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:30.926928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdbbb20-f4e7-4bb2-8f85-116752cb67b5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:30.929134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 103/207] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:30 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:30.938365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:31.048187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a62096-0f48-4af2-b0bc-927753ba4320 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:31.058255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:31.092925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:31.093969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:31.094454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:31.094917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:31.095951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, scope.project.id=245b589d4dce4345805725887ff002da, user.id=b0f460ede9d54c3c81de50b5ebbab88e) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:31.096454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:31.098122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9cd4f-53c7-4422-ac62-393d6412994c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:31.108832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 105/208] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:30 2022] GET /identity/v3/role_assignments?user.id=b0f460ede9d54c3c81de50b5ebbab88e&scope.project.id=245b589d4dce4345805725887ff002da&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:32.366669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c6de-ae0f-41a0-b806-13942eb58e21 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.367179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c6de-ae0f-41a0-b806-13942eb58e21 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.367253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3c6de-ae0f-41a0-b806-13942eb58e21 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.368830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 104/209] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:32.374451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13079e-587a-423b-a3f2-afb8892b3dcd None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.374858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13079e-587a-423b-a3f2-afb8892b3dcd None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.375084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13079e-587a-423b-a3f2-afb8892b3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.392668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1d13079e-587a-423b-a3f2-afb8892b3dcd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:32.393910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1d13079e-587a-423b-a3f2-afb8892b3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:32.468744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 106/210] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:32.492680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c6de-ae0f-41a0-b806-13942eb58e21 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:32.511259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6a71-ab27-4311-abd2-073c9546eb34 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.511557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6a71-ab27-4311-abd2-073c9546eb34 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.512498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c6a71-ab27-4311-abd2-073c9546eb34 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.513962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 107/211] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:32.519105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353b1d-fd07-44c5-8dcd-b342db65b00e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.519878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353b1d-fd07-44c5-8dcd-b342db65b00e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.520185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40353b1d-fd07-44c5-8dcd-b342db65b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.546041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-40353b1d-fd07-44c5-8dcd-b342db65b00e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:32.548370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-40353b1d-fd07-44c5-8dcd-b342db65b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:32.562315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.612264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3c6de-ae0f-41a0-b806-13942eb58e21 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:32.645516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 108/212] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:32.648359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959776-dd9f-4384-adfb-2bc8aa5e0b4f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.648864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959776-dd9f-4384-adfb-2bc8aa5e0b4f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.650338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d959776-dd9f-4384-adfb-2bc8aa5e0b4f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.653734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 109/213] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:32.662291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.662291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.662712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.666722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:32.667740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.668433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.668933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.680953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:32.688754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:32.689995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:32.691652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:32.693226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:32.694470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:32.694599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 105/214] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:32.696170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:32.728019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.785283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 110/215] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:32.785283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:32.819056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb492-7912-40a2-b01f-8084e122ca42 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:32.834084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.858194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:32.859427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.859911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.860528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.861973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:32.863866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:32.865741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 106/216] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:32.866747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:32.890354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a47e9a-76f1-4965-90ff-760794ddc83a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:32.927705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:32.928391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:32.928683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:32.928961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:32.929759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:32.930072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:32.931468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:32.940474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 111/217] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:32.945427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:32.971791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:32.973777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2856fc5-0a2d-45a6-b2db-7cb10e138c41 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.008295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.009094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.009412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.009694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.020035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:33.028592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:33.029530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:33.030514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 107/218] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:33.034088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.046829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ffad0-283e-40e3-92e8-52f06d4ace3e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.074828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.079985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.080645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.080973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.086102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.086102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.086102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.133139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb2cbf-b183-4ce6-b825-270135aec1cf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.165747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.166619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.166892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.167165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] PATH_INFO: `/v3/users/baa01e3fbe054a6eb8105577c5f29165` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.179865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] RBAC: Authorizing `identity:get_user(user_id=baa01e3fbe054a6eb8105577c5f29165)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.181248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a021e11-ce45-422a-85ba-8fe1824264b6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.182901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 108/219] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/users/baa01e3fbe054a6eb8105577c5f29165 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:33.184210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc2fa-7393-4a75-91d9-874d2ee09eea None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.184490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc2fa-7393-4a75-91d9-874d2ee09eea None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.184762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258dc2fa-7393-4a75-91d9-874d2ee09eea None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.186014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 109/220] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:33.186697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc2fa-7393-4a75-91d9-874d2ee09eea None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.222695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 112/221] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:32 2022] POST /identity/v3/users => generated 297 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:33.236371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.292937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.298166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258dc2fa-7393-4a75-91d9-874d2ee09eea None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.332740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.339348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.340103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.340384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.340976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.341453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:33.343949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.343949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33d9062-2e1a-4938-b3b7-87db31e2e2f9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.352930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 110/222] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:33.354691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.355157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.356283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.359079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24161404-aa52-4764-abbf-72c1da2e9942 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.378520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:33.380477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:33.397056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.397758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.398043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.398316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.456376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 111/223] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:33.457225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.482022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.483775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.561038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.572229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe736cf-4e07-4bc7-a291-447482442748 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.610853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.612136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.612465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.612706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.613943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.615459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.617248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 112/224] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:33.617915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.660571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.687680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 113/225] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:33.692292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.772067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8997871a-6b5f-4543-9c0c-37b254394e57 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.816590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.817802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.818166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.818453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.825560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948064d9-0a3c-43f1-91a6-dd7b1c84f5ec None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:33.832048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:33.843341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:33.844264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:33.845035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 113/226] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:33.846207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.874752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.879441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:33.880985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:33.881511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:33.882193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:33.883998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:33.885906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:33.888995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 114/227] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:33.889965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:33.960092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:33.961094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f8defa-372e-4a3a-8602-94a4cd9cf0d2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.002011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.003386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.003816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.004235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.006216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.007818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.010510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 114/228] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:34.015485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:34.030147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde6db0-e2b5-4a8e-ace2-167d36f2b58d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.078652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.079856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.080562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.081037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.082129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:34.082438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.084635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.097536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 115/229] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:34.098434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:34.114339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:34.135193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408568b-1ed1-44a9-b407-6d54f89e3f9f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.180953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.182186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.182651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.183471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/14c287dc5f034438897143cac143be29/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.186675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, user_id=14c287dc5f034438897143cac143be29, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.188836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.207994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5217cc3f-ecb2-4dde-b49b-ee2b9335b0b3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.220388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:34.244126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.244865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.245151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.245535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.247155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=baa01e3fbe054a6eb8105577c5f29165) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:34.247466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.249038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.261437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 116/230] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:34 2022] GET /identity/v3/role_assignments?user.id=baa01e3fbe054a6eb8105577c5f29165&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:34.261437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:34.279030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 115/231] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:34 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/14c287dc5f034438897143cac143be29/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:34.404097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea0c8e-a87f-4dd9-9904-34f420583c7f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.455677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.456579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.456859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.457130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.458420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.460180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.462355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 117/232] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:34 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:34.468750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:34.591924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5271ab3-ead4-48e8-82b1-66b31f16df53 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.630719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.631595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.631882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.632161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.633427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.635547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71e96c-6a7d-493a-95a9-ff1f07324c8c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.638177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 116/233] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:34 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:34.643428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:34.701889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:34.764598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10a73a-c8f1-4fda-803c-cfc230bbacd6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:34.803510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:34.805066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:34.805594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:34.806073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/14c287dc5f034438897143cac143be29/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:34.814179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, user_id=14c287dc5f034438897143cac143be29, role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:34.815677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d99c6-eacd-4c8e-b302-21454e5206a6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:34.918031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 118/234] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:34 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/14c287dc5f034438897143cac143be29/roles/5daf32e946ee47d98d2041330c41a624 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:35.695773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f831-0ec7-494d-b2e9-5a72f26fee84 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:35.696288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f831-0ec7-494d-b2e9-5a72f26fee84 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:35.696397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f831-0ec7-494d-b2e9-5a72f26fee84 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:35.698072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 117/235] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:35.704264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615279-c622-4079-b17c-7fd7647751d2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:35.704769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615279-c622-4079-b17c-7fd7647751d2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:35.704853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92615279-c622-4079-b17c-7fd7647751d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:35.725746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-92615279-c622-4079-b17c-7fd7647751d2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:35.726924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-92615279-c622-4079-b17c-7fd7647751d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:35.819562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 119/236] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:35.863828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f831-0ec7-494d-b2e9-5a72f26fee84 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:35.879960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:35.887498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b2b5-fd71-4aaa-8f77-4366d8aea868 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:35.894632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b2b5-fd71-4aaa-8f77-4366d8aea868 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:35.894632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7b2b5-fd71-4aaa-8f77-4366d8aea868 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:35.894632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 120/237] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:35.897025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:35.897330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:35.897612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:35.927111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:35.928299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:35.987698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f831-0ec7-494d-b2e9-5a72f26fee84 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:35.989809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:36.033026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.034254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.035302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.036512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.039719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:36.041477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:36.049629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 118/238] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:36.054821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:36.083301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 121/239] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:36.130439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:36.190361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:36.225430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8806a2-a2b3-4d98-99b5-b6acce3fa93d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:36.299915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfd2d0-ca6c-46e8-bee9-30b728edc6b1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:36.301987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.302667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.302947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.303221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.303932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:36.305405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:36.351723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.352503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.352784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.353055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.364147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:36.372203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:36.373115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:36.373962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 122/240] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:36.382250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:36.408382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:36.428552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 119/241] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:36 2022] POST /identity/v3/users => generated 293 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:36.495687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca233-3be6-43c0-a67c-91a88c814f5d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:36.535765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.536456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.536787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.537062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.540119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:36.540119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:36.540119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:36.549833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 123/242] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:36.555424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:36.692509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57ff49-546c-4176-be43-a7db2bbfcc24 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:36.736199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839fd21c-420d-415e-9576-b66366765376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.737962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fd21c-420d-415e-9576-b66366765376 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.738456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fd21c-420d-415e-9576-b66366765376 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.738956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839fd21c-420d-415e-9576-b66366765376 None admin] PATH_INFO: `/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.748606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:36.756319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fd21c-420d-415e-9576-b66366765376 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5c82f3b8ff44f2b0b44e14148e7ae7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:36.757923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839fd21c-420d-415e-9576-b66366765376 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:36.760049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 120/243] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:36 2022] GET /identity/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:36.765863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:36.862779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:36.878694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74628cd-c961-4a67-9df2-a107da54bfc9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:36.916226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:36.916891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.917172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.917478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.955358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df875-0677-4143-8106-807108e38cc0 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.955973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df875-0677-4143-8106-807108e38cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.956455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7df875-0677-4143-8106-807108e38cc0 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.958346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 121/244] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:36.964132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:36.965022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:36.965655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:36.990935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:36.992509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:37.009547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:37.010783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:37.093463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:37.102349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 122/245] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:37.115918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 124/246] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:37.116087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.128051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.231898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7663ff-b3ab-4677-9f77-0fa911593dcb None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:37.243955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d5719-125c-48ff-bf45-9994d73b4ca4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:37.263081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:37.273925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:37.274976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.275267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.275544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.276823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:37.279177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1583d41-d980-4787-b65a-090f5755ce73 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:37.281116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 123/247] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:37.282151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4b02-b5a3-4dcc-81c3-86b8568089f3 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.282437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4b02-b5a3-4dcc-81c3-86b8568089f3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.282722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c4b02-b5a3-4dcc-81c3-86b8568089f3 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.284123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 124/248] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:37.287817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c4b02-b5a3-4dcc-81c3-86b8568089f3 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.292038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:37.293497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.293940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.294214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.312048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-78d84980-0434-41ee-ab47-6d611ef867f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:37.318439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:37.319297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:37.320104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:37.322906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 125/249] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:37.324471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.324960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.325451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.343953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:37.345559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:37.389025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:37.405957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c4b02-b5a3-4dcc-81c3-86b8568089f3 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:37.418296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 126/250] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:37.419459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.449804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:37.451504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.452126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.453230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.454322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=8c5c82f3b8ff44f2b0b44e14148e7ae7) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:37.454955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:37.459524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:37.472354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 125/251] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/role_assignments?user.id=8c5c82f3b8ff44f2b0b44e14148e7ae7&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:37.479340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.621633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:37.672117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813273-752b-4d36-81d6-faab914ef356 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:37.716803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df672b-86f9-4443-b628-b8d858544c74 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:37.743550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:37.744245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.744527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.744799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.745900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:37.746413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:37.747836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:37.766702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 127/252] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:37.773034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.802100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:37.802836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:37.803116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:37.803382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:37.826530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:37.835652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:37.836591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:37.837441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 126/253] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:37.849908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:37.850285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:37.972207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22248e76-4677-4a3f-ae0b-c4f4a209d418 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.035245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc73d9-8ef7-4912-b36d-e94179f47357 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.044066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.045156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.045599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.046082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] PATH_INFO: `/v3/users/baa01e3fbe054a6eb8105577c5f29165` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.047566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] RBAC: Authorizing `identity:get_user(user_id=baa01e3fbe054a6eb8105577c5f29165)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.049236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.051433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 128/254] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/users/baa01e3fbe054a6eb8105577c5f29165 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:38.057803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.067230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:38.087776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.088468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.088898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.089190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.090725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:38.091088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.092735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720d946-ba3e-4681-94f0-fb6ec941eb2a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.102738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 127/255] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:38.105106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684ade-31e4-427a-af66-ad7e2e7563e2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.106130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684ade-31e4-427a-af66-ad7e2e7563e2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.106943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6684ade-31e4-427a-af66-ad7e2e7563e2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.109050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 128/256] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:38.112244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684ade-31e4-427a-af66-ad7e2e7563e2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.248838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e8fcf-e772-48c6-8edf-5dca77146f73 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.253173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:38.258014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6684ade-31e4-427a-af66-ad7e2e7563e2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.312837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.314229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.314719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.315192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.316643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.318515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3364a622-2351-46cb-ab8d-a57fe3786ff4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.320788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 129/257] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:38 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:38.322111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.322515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.322983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.323231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.323340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.323504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.324637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.325974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.327436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.329394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 129/258] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:38 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:38.330159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.344975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:38.346679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:38.399214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:38.427680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 130/259] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:38.428986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.533998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089690a-3073-4348-be5e-47a69c1cae73 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.603021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98187b-a13f-4b6f-b0e8-345eb4003670 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:38.613655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.614328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.614620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.614876 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.671179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:38.672074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:38.672355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:38.672631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/baa01e3fbe054a6eb8105577c5f29165/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:38.675296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, user_id=baa01e3fbe054a6eb8105577c5f29165, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.676741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.686336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:38.715283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:38.716751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:38.768439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 131/260] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:38 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/baa01e3fbe054a6eb8105577c5f29165/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:38.769360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.853739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:38.877862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 130/261] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:38.883260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:38.969957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8050c2-5025-42ef-b5a4-60006b7279dd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.055512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.056406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.056694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.056963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.061625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:39.084182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:39.093189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:39.094178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:39.094973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:39.102973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 132/262] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:39.110733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:39.142565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb3abf8-8036-4363-8713-3aa458ccfca6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.194522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.195407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.195689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.195963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.197142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:39.198624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:39.201284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 131/263] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:38 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:39.210221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:39.220082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:39.226337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f2d81-60bb-4207-82c3-41893aa6162f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.263851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.264901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.265442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.265923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.266881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:39.267394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:39.269016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:39.278630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 133/264] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:39.302335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:39.368692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b5599-287b-40dd-9506-1e5013d22458 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.419119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.419797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.420079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.420352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.421192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=14c287dc5f034438897143cac143be29) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:39.421535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:39.423048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:39.429790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 132/265] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:39 2022] GET /identity/v3/role_assignments?user.id=14c287dc5f034438897143cac143be29&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:39.457518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf599b-9843-4a86-a3f4-c1eafc72d779 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.507245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.508571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.509091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.513774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] PATH_INFO: `/v3/users/14c287dc5f034438897143cac143be29` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.515571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=14c287dc5f034438897143cac143be29)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:39.517374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:39.525206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 134/266] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:39 2022] GET /identity/v3/users/14c287dc5f034438897143cac143be29 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:39.534493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:39.540779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:39.666216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34e74-c036-48e2-b4c4-efd212b8c960 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:39.709118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:39.709816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:39.710101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:39.710374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:39.787643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:39.789138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:39.797819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:39.910638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 133/267] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:39.917057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:39.988516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:40.064395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26931a-56ca-4795-a6f1-1e9b85955ea0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.114223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.115098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.115387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.115665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.118099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:40.119562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101c895-767a-41a6-b9b9-c3f8136bf417 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:40.122705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 135/268] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:39 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:40.128478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.163271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2449a-818b-4524-b328-833d52983a77 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.163717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2449a-818b-4524-b328-833d52983a77 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.164097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2449a-818b-4524-b328-833d52983a77 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.165629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 136/269] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:40.171368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc7320-02c3-4118-9dfd-3ae9ce8776be None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.171513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc7320-02c3-4118-9dfd-3ae9ce8776be None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.171890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc7320-02c3-4118-9dfd-3ae9ce8776be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.190596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-07cc7320-02c3-4118-9dfd-3ae9ce8776be None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:40.191963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-07cc7320-02c3-4118-9dfd-3ae9ce8776be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:40.272384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 137/270] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:40.274407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f2e0-94d2-4b0f-92ed-502b3bf02749 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.274698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f2e0-94d2-4b0f-92ed-502b3bf02749 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.274980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d5f2e0-94d2-4b0f-92ed-502b3bf02749 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.278148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 138/271] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:40.285211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.286465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.287573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.305826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249e95-80f1-49f0-9242-ee7658e63f0d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.310321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:40.313400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:40.314595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:40.346523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.347413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.348249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.348554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.349739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=14c287dc5f034438897143cac143be29) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:40.350061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:40.351983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:40.357592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:40.359033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 134/272] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:40 2022] GET /identity/v3/role_assignments?user.id=14c287dc5f034438897143cac143be29&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=5daf32e946ee47d98d2041330c41a624 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:40.359826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.464133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 139/273] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:40.520909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55de5a-3431-4225-9d03-88e5d4ad9510 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.538068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.563211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.564029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.564309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.564577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.565934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:40.567420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:40.569428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 135/274] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:40.576816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.640664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:40.702050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860893d-620a-4431-95b7-5f7aaceceb46 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.731826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b2c6b0-6501-4b8a-8534-298271eeb336 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.750054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.750867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.751154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.751444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.762588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c240e264-14bd-4c5e-8788-2f46eb146bb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:40.770284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:40.771209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:40.771979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:40.772588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.772588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.772588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.772588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.772833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 140/275] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:40.772896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:40.773547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1386c1-0d18-4514-b414-bafa9225a5fe None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.773547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1386c1-0d18-4514-b414-bafa9225a5fe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.773709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1386c1-0d18-4514-b414-bafa9225a5fe None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.773961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a15666-85ea-4e9a-889c-3256642e1183 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:40.775070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 141/276] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:40.779868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1386c1-0d18-4514-b414-bafa9225a5fe None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.800594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:40.871687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 136/277] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:17:40 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:40.873069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.873462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.873818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.893539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1386c1-0d18-4514-b414-bafa9225a5fe None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:40.893842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:40.895610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:40.943846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:40.945311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:40.945864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:40.946413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:40.947392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:40.947847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:40.949763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:40.962186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 142/278] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:40.969297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:40.996870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 137/279] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:41.018898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.044794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.077977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.104164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad91fd-c0d9-4178-960a-4acdd2f81478 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.132737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb410f-dc39-434a-8e1a-fb5e69046fb2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.151524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.153107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.153625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.154163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] PATH_INFO: `/v3/users/45580089ad15475abe399589ea52dd81` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.168281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] RBAC: Authorizing `identity:get_user(user_id=45580089ad15475abe399589ea52dd81)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:41.170185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:41.173354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 143/280] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:40 2022] GET /identity/v3/users/45580089ad15475abe399589ea52dd81 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:41.178296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.178996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.179102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.179385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.179660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.194402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:41.203426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:41.204351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:41.205150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:41.206193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 138/281] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:41.212821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.309141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55365643-3282-4ad1-9147-b0c2b598f69c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.317901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.344407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d7ba7-3aa2-4491-aaaa-a9b1f2a605b0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.353420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.354092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.354383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.354660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.356240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, user.id=45580089ad15475abe399589ea52dd81, scope.system=all) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:41.356557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:41.358044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:41.361160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.364576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 144/282] 10.222.0.71 () {56 vars in 1308 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/role_assignments?user.id=45580089ad15475abe399589ea52dd81&scope.system=all&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:41.393564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.394267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.394552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.394892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.395673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:41.396037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:41.397550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:41.408236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 139/283] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:41.414282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.545509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31726819-2a57-489a-90da-e40c2af34639 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.582475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.583275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.583556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.584084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] PATH_INFO: `/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.585330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5c82f3b8ff44f2b0b44e14148e7ae7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:41.586789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab0451-fb5b-42e5-a5bf-d3335a31dac3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:41.588769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 145/284] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:41.594614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.678089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091402-d2f7-4354-8fb0-b99fda70abb9 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.678749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091402-d2f7-4354-8fb0-b99fda70abb9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.679224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96091402-d2f7-4354-8fb0-b99fda70abb9 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.680803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 146/285] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:41.686897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.687180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.687461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.710332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:41.711536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:41.757441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d81fd-2112-43b2-b8e0-97d1a1a478ea None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:41.804225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.810734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 147/286] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:41.828405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:41.829311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:41.829702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:41.829979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:41.833472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:41.834166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.835181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:41.837198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 140/287] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:41.849130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:41.877525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:41.964049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a18077-0b9c-44df-9fdc-49cfe19607cd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.016156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.017019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.017363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.017650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:42.029782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:42.037779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:42.038658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:42.039443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 148/288] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:42.047096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:42.051178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d150269-df40-48e0-a192-a320d84c3cae None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.109827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:42.111738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.112907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.113418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.118123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/8c5c82f3b8ff44f2b0b44e14148e7ae7/roles/1ea8ae00b320441b9e0c1b4a9d2d7102` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:42.123699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, user_id=8c5c82f3b8ff44f2b0b44e14148e7ae7, role_id=1ea8ae00b320441b9e0c1b4a9d2d7102)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:42.125652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:42.156678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef1f2e-bcd7-496e-b4fa-edbe9e9ea2f7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.192521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.193248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.193565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.193887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:42.194639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:42.194943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:42.196322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:42.205832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 149/289] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:42.211453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:42.245796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 141/290] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:17:41 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/users/8c5c82f3b8ff44f2b0b44e14148e7ae7/roles/1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:17:42.325648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39168-a587-48ff-b358-d436bef87c13 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.347973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:42.367942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.367942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.367942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.367942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] PATH_INFO: `/v3/users/baa01e3fbe054a6eb8105577c5f29165` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:42.368393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] RBAC: Authorizing `identity:get_user(user_id=baa01e3fbe054a6eb8105577c5f29165)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:42.368393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:42.368819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 150/291] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:42 2022] GET /identity/v3/users/baa01e3fbe054a6eb8105577c5f29165 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:42.375549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:42.457512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:42.502288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536addd-2bed-4cbb-8344-435158158a69 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.610145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.611213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.611718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.612186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:42.694510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:42.696277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:42.770324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:42.814061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 142/292] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:42.819575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:42.959825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147d015-5d3b-4219-9ac0-9a214c03fce3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:42.996127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:42.997801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:42.998287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:42.998792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.000195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:43.001857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2913b1-b4f3-4399-b511-ed33f28c6922 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:43.003750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 151/293] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:42 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:43.009638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:43.152306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561faa24-10e9-4c86-a9e2-a62c7286fa38 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:43.187531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:43.188191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:43.188470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:43.188738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.189601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=baa01e3fbe054a6eb8105577c5f29165) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:43.189908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:43.191359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8432d-aa21-4d4d-a0f8-707a235f12ae None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:43.198008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 143/294] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:43 2022] GET /identity/v3/role_assignments?user.id=baa01e3fbe054a6eb8105577c5f29165&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:43.785211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf476c-0d8a-4e58-a4d5-e2cd4e0596bd None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:43.785922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf476c-0d8a-4e58-a4d5-e2cd4e0596bd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:43.786409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bf476c-0d8a-4e58-a4d5-e2cd4e0596bd None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.788078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 152/295] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:43.794535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3825788-b5aa-49db-bd38-a7c554c76727 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:43.795165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3825788-b5aa-49db-bd38-a7c554c76727 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:43.795662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3825788-b5aa-49db-bd38-a7c554c76727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.817069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b3825788-b5aa-49db-bd38-a7c554c76727 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:43.818617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b3825788-b5aa-49db-bd38-a7c554c76727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:43.852643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:43.907205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 144/296] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:43.931115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf476c-0d8a-4e58-a4d5-e2cd4e0596bd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:43.936512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a824-38cd-437d-927e-62b6076ad249 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:43.936800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a824-38cd-437d-927e-62b6076ad249 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:43.937075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77a824-38cd-437d-927e-62b6076ad249 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.938482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 145/297] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:43.946650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:43.946942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:43.947222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:43.964922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:43.966375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:43.996822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.044530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bf476c-0d8a-4e58-a4d5-e2cd4e0596bd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.063213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 146/298] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:44.081575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.093715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.094516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.094796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.095064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.109086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:44.121230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:44.122330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:44.123193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 153/299] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:44.130781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.201231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.207935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b5fb6-2b9a-4c5e-a904-00af6bbe569b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.238142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b675974-b755-4c3c-8584-96ffcff8f5ce None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.247904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.248702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.248985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.249271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.250506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.251961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a528019-917a-4f8d-badd-580f65b402f1 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.253613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 147/300] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:44.256018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.258594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0179-5359-4251-8cb5-d5e6f9b99d8b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.258874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0179-5359-4251-8cb5-d5e6f9b99d8b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.259148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0179-5359-4251-8cb5-d5e6f9b99d8b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.260405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 148/301] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:44.262880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0179-5359-4251-8cb5-d5e6f9b99d8b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.278562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.279408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.279516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.279777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.280532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] RBAC: Adding query filter params (name=reader) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:44.280813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.282244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506fc8d-6f0e-499b-bdf5-185046a87eac None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.293427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 154/302] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:44.294762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.294996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.295272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.311119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:44.312292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:44.373108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0179-5359-4251-8cb5-d5e6f9b99d8b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.393472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 155/303] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:44.393472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.416142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.416819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.417102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.418033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] PATH_INFO: `/v3/groups` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.418695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.420139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.499734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 149/304] 10.222.0.71 () {60 vars in 1134 bytes} [Fri May 27 03:17:44 2022] POST /identity/v3/groups => generated 229 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:17:44.500909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.515813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be8164-3bd5-481e-af92-ab9bb6246ff5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.532614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.546310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.570145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.571328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.575251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.575251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] PATH_INFO: `/v3/users/c4000271629445c1944e1e5b0dd940d2` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.588459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] RBAC: Authorizing `identity:get_user(user_id=c4000271629445c1944e1e5b0dd940d2)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.590632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.593466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 156/305] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/users/c4000271629445c1944e1e5b0dd940d2 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:44.606802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.622745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880cc80-f962-4fc9-b0df-6fd5ad2bd929 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.666293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.667410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.667906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.668193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.680768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:44.689852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:44.690798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:44.691582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:44.696024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 150/306] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:44.696945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.738324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c68f03-0286-4cc1-831e-427d1d4bf366 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.788179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.788847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.789165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.789473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.790338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, user.id=c4000271629445c1944e1e5b0dd940d2, scope.system=all) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:44.790623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.792073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.800532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 157/307] 10.222.0.71 () {56 vars in 1308 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/role_assignments?user.id=c4000271629445c1944e1e5b0dd940d2&scope.system=all&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:44.811404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.831456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0deec-d434-4015-99b5-9bbe104a3497 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:44.873187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:44.873928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.874218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.874565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.875346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:44.875708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:44.877132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b412c-a675-486c-855a-b6fea0029eca None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:44.888506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 151/308] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:44.894253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:44.935471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:44.951768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71afadf-5bc6-4c5e-b4ab-b50151a91116 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.952085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71afadf-5bc6-4c5e-b4ab-b50151a91116 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.952336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71afadf-5bc6-4c5e-b4ab-b50151a91116 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.953776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 152/309] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:44.960133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:44.960442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:44.960691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:44.981242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:44.982611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:45.024476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be34c1e-42bc-4ed2-93a9-5cfeda5e55e0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.060697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 153/310] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:45.067820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.068738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.069023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.069314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] PATH_INFO: `/v3/users/45580089ad15475abe399589ea52dd81` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.070499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] RBAC: Authorizing `identity:get_user(user_id=45580089ad15475abe399589ea52dd81)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:45.071993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:45.073943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 158/311] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:44 2022] GET /identity/v3/users/45580089ad15475abe399589ea52dd81 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:45.082352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:45.084683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:45.177079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:45.201359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:45.205393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fbe34d-6f6f-4bef-90b2-15b8d8dfad53 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.212299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5dc5dc-0891-4c04-bd75-c6103f1a7d7a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.250632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.252711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.253013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.253328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.260352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.262397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.262910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.263390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] PATH_INFO: `/v3/system/users/45580089ad15475abe399589ea52dd81/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.264907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:45.265677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=45580089ad15475abe399589ea52dd81, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:45.267285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:45.273960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:45.274936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:45.275735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 159/312] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:45.282881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:45.365383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 154/313] 10.222.0.71 () {58 vars in 1334 bytes} [Fri May 27 03:17:45 2022] PUT /identity/v3/system/users/45580089ad15475abe399589ea52dd81/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:45.406202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663e81f-8185-4b8a-9a1f-d59be10699c3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.444882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.445757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.446114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.446463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.447306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:45.447694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:45.450102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:45.460211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 160/314] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:45.466134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:45.580256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7030e2a0-73a9-44e8-8c05-24ac4e14c8b6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.617985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.618853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.619232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.619516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] PATH_INFO: `/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.621570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c5c82f3b8ff44f2b0b44e14148e7ae7)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:45.623135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:45.624988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 155/315] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:45 2022] GET /identity/v3/users/8c5c82f3b8ff44f2b0b44e14148e7ae7 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:45.630363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:45.680463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:45.762625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17b0aa-740b-4dab-8743-4f00f993bd51 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:45.800177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:45.801106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:45.801596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:45.802022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:45.876244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:45.877952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:45.900723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:45.986304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 161/316] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:45.992073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:46.004687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:46.102214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d0309a-8d37-47d6-9b98-529178516ad2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:46.143053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:46.144148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:46.144595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:46.145020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:46.146505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:46.148122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459cca2-051d-4761-a4df-a857d8b0357d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:46.150283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 156/317] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:45 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:46.156859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:46.265506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c10ec-451c-4b97-bfe9-8fd8d1fbd397 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:46.285548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:46.299456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:46.300117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:46.304555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:46.304555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:46.304555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, scope.project.id=979caeeeb49c47f284e40be82b0162cc, user.id=8c5c82f3b8ff44f2b0b44e14148e7ae7) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:46.304555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:46.304555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671f166-a078-4492-ae04-2e90392b65ed None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:46.310289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 162/318] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:17:46 2022] GET /identity/v3/role_assignments?user.id=8c5c82f3b8ff44f2b0b44e14148e7ae7&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:46.916820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1476b7-fcb4-4bda-9127-9fad67f56a39 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:46.918032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1476b7-fcb4-4bda-9127-9fad67f56a39 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:46.918032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1476b7-fcb4-4bda-9127-9fad67f56a39 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:46.919308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 157/319] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:46.924462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2212d-97fb-4d4f-aac8-5d18b87312f4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:46.924756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2212d-97fb-4d4f-aac8-5d18b87312f4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:46.925031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2212d-97fb-4d4f-aac8-5d18b87312f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:46.941579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-dca2212d-97fb-4d4f-aac8-5d18b87312f4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:46.942742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dca2212d-97fb-4d4f-aac8-5d18b87312f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:47.016970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 163/320] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:47.039661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1476b7-fcb4-4bda-9127-9fad67f56a39 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.119735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:47.144535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1476b7-fcb4-4bda-9127-9fad67f56a39 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.174847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb9740-dbaf-44de-a0cf-ce8f4a445467 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.175957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb9740-dbaf-44de-a0cf-ce8f4a445467 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.176396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdb9740-dbaf-44de-a0cf-ce8f4a445467 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.177866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 164/321] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:47.180439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.181237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.181559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.182098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.183664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.183879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:47.184153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.184485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.185337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:47.187211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 158/322] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:17:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:47.192653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.201919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:47.203115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:47.281220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 165/323] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:47.301746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f738d6-156d-4bff-957c-bc367e0b739f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.304024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.341605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.342275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.342556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.342832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] PATH_INFO: `/v3/groups` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.343509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:47.344945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0e3da-ebb7-4986-9267-4c94adffd00c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:47.355445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:47.411924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ea6d0-207d-4e7e-acf6-8be2f566c329 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.445632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.446362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.446682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.446959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.456954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:47.465157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:47.466164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:47.467219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 166/324] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:47.472197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.574612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492dfab-81b6-4f66-9b26-9ff6e7bea14b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.607007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.607672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.607971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.608233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.608972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:47.609312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:47.610677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:47.618582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 167/325] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:47.624633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.722256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0bb66-f91c-45b8-94f2-25945ac6fe6d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.738350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 159/326] 10.222.0.71 () {60 vars in 1134 bytes} [Fri May 27 03:17:47 2022] POST /identity/v3/groups => generated 226 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:17:47.739741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf28b1-63b5-4d12-9eda-3e5e8937ef7d None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.740156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf28b1-63b5-4d12-9eda-3e5e8937ef7d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.740437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf28b1-63b5-4d12-9eda-3e5e8937ef7d None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.741819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 160/327] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:47.748174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.748454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.748730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.754902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:47.760426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.761448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.761772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.762052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] PATH_INFO: `/v3/users/c4000271629445c1944e1e5b0dd940d2` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.763364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=c4000271629445c1944e1e5b0dd940d2)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:47.764850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:47.766616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 168/328] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:47 2022] GET /identity/v3/users/c4000271629445c1944e1e5b0dd940d2 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:47.768490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:47.769752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:47.772557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.797371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:47.857674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 161/329] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:47.882124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:47.887008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b093f53-5937-49b2-a06e-8017107ec9d5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:47.898418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:47.926619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:47.928328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:47.928328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:47.928506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] PATH_INFO: `/v3/system/users/c4000271629445c1944e1e5b0dd940d2/roles/1ea8ae00b320441b9e0c1b4a9d2d7102` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:47.930411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c4000271629445c1944e1e5b0dd940d2, role_id=1ea8ae00b320441b9e0c1b4a9d2d7102)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:47.932176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:47.990858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab740547-8847-4adb-a711-95c65e0dd2ff None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:48.026466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:48.027327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:48.027611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:48.027886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:48.029867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:48.039311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:48.043036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 169/330] 10.222.0.71 () {58 vars in 1334 bytes} [Fri May 27 03:17:47 2022] PUT /identity/v3/system/users/c4000271629445c1944e1e5b0dd940d2/roles/1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:48.047597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:48.048531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:48.049433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:48.053360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 162/331] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:48.055249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:48.183938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:48.188995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7511b-de4e-49c9-a163-248ab7b09678 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:48.234029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:48.234746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:48.235083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:48.235370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:48.236149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:48.236457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:48.238010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:48.249498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 170/332] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:48.254139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:48.375669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b8a98-57c8-495a-9f2e-b63d2fdf0b89 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:48.417871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:48.418871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:48.419155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:48.419429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] PATH_INFO: `/v3/users/45580089ad15475abe399589ea52dd81` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:48.420665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] RBAC: Authorizing `identity:get_user(user_id=45580089ad15475abe399589ea52dd81)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:48.422266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e0a71-1c30-4f88-b44d-5f5785848db0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:48.424195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 163/333] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:48 2022] GET /identity/v3/users/45580089ad15475abe399589ea52dd81 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:48.429858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:48.560881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3b6c-efc0-45ad-897f-8f5fa2f022e5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:48.601790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:48.602467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:48.602751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:48.603025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:48.603862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] RBAC: Adding query filter params (role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, user.id=45580089ad15475abe399589ea52dd81, scope.system=all) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:48.604176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:48.605885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15410fd2-4e9b-4833-87a6-3ef6853a3f50 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:48.619269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 171/334] 10.222.0.71 () {56 vars in 1308 bytes} [Fri May 27 03:17:48 2022] GET /identity/v3/role_assignments?user.id=45580089ad15475abe399589ea52dd81&scope.system=all&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:50.576564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b57f5-5803-494c-ae32-dd843b1c82ba None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:50.577102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b57f5-5803-494c-ae32-dd843b1c82ba None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:50.577102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b57f5-5803-494c-ae32-dd843b1c82ba None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:50.578871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 164/335] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:50.584535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0cf0-00dd-4c26-9a5f-86997c82c32b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:50.585001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0cf0-00dd-4c26-9a5f-86997c82c32b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:50.585082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f0cf0-00dd-4c26-9a5f-86997c82c32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:50.609963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c09f0cf0-00dd-4c26-9a5f-86997c82c32b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:50.611172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c09f0cf0-00dd-4c26-9a5f-86997c82c32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:50.625777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:50.700254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 172/336] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:50.735636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b57f5-5803-494c-ae32-dd843b1c82ba None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:50.809366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:50.857980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b57f5-5803-494c-ae32-dd843b1c82ba None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:50.895491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4831-bdee-46cd-8bb8-3f291d1b45ae None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:50.896136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4831-bdee-46cd-8bb8-3f291d1b45ae None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:50.896614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a4831-bdee-46cd-8bb8-3f291d1b45ae None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:50.901991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 173/337] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:50.903573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:50.904199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50077-a662-44f0-96bc-40a494243074 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:50.904383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:50.904489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50077-a662-44f0-96bc-40a494243074 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:50.904670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:50.904776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d50077-a662-44f0-96bc-40a494243074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:50.904948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:50.923604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:50.931710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:50.933305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:50.934575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 165/338] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:50.942097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:50.953378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-24d50077-a662-44f0-96bc-40a494243074 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:50.954586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-24d50077-a662-44f0-96bc-40a494243074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:51.092643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 174/339] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:51.093777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d551-8a23-4499-b080-336fa61dbb3a None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.094052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d551-8a23-4499-b080-336fa61dbb3a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.094331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284d551-8a23-4499-b080-336fa61dbb3a None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.099486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 175/340] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:51.106420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254ed6-54e8-4c22-b901-ad8273c5e381 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.106713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254ed6-54e8-4c22-b901-ad8273c5e381 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.106996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36254ed6-54e8-4c22-b901-ad8273c5e381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.129628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4f3f6-cfb7-4630-91a8-67baa8f3caf7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.145419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-36254ed6-54e8-4c22-b901-ad8273c5e381 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:51.146634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-36254ed6-54e8-4c22-b901-ad8273c5e381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:51.181687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.208064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.208998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.209306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.209597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.210601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:51.211015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:51.212416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:51.226631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 166/341] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:51.227335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.265437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 176/342] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:51.266923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22eb1-ba61-4beb-83e7-98ef66dfc15d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.267216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22eb1-ba61-4beb-83e7-98ef66dfc15d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.267494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a22eb1-ba61-4beb-83e7-98ef66dfc15d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.268844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 177/343] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:51.269596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a22eb1-ba61-4beb-83e7-98ef66dfc15d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.292439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.381052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542a30c-e79f-4683-818e-6df8fdd9e37e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.413318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a22eb1-ba61-4beb-83e7-98ef66dfc15d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.434870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.435225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.437737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.438252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.452301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:51.456759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.457665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.457952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.458226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] PATH_INFO: `/v3/users/c4000271629445c1944e1e5b0dd940d2` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.459668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] RBAC: Authorizing `identity:get_user(user_id=c4000271629445c1944e1e5b0dd940d2)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:51.461119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-74c03d4e-57f9-45c7-b7da-448d69fcec6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:51.462331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:51.463232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:51.464369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:51.466863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 167/345] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:51.467077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 178/345] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/users/c4000271629445c1944e1e5b0dd940d2 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:51.468181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.468791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.469550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.470295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.493301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:51.495478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:51.544571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.556298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.577487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 168/346] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:51.578926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.584957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ca0ab-d39c-4cfd-ae6f-df4c6ead774a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.633160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.633966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.634250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.634523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.650286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:51.661894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:51.662983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:51.663803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 179/347] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:51.669053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.706494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555a5b-7ffa-49ac-adb8-fe720faab601 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.752438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.753708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.754214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.754785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.755756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:51.756377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:51.758113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:51.769470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 169/348] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:51.771134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.779623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024660-1b12-4c04-87b8-62310bd7fcbb None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.813078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.814860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.815632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.816012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.816384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.817376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] RBAC: Adding query filter params (role.id=1ea8ae00b320441b9e0c1b4a9d2d7102, user.id=c4000271629445c1944e1e5b0dd940d2, scope.system=all) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:51.817733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:51.821623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:51.822883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:51.841423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 180/349] 10.222.0.71 () {56 vars in 1308 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/role_assignments?user.id=c4000271629445c1944e1e5b0dd940d2&scope.system=all&role.id=1ea8ae00b320441b9e0c1b4a9d2d7102 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:51.842552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.895733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43fc3d-4624-4389-86de-f0cf2dafcb77 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:51.939488 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:51.940798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:51.941326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:51.941833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:51.955866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:51.966224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:51.967169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:51.967959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:51.970916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 170/350] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:51.971994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:51.974721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e13a3d-cf8d-40c1-8392-9d45117d99cd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.031071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.031769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.032056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.032534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.033068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:52.033397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.034779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.052522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 181/351] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:52.053581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.095882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.107355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf1c68-910c-453e-a394-3ac3cfefc326 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.128726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.158120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.159140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.159697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.160173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.175342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe59bc-4a23-4474-8a59-c4cc4a997287 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.239040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.239732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.240010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.240286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.241039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:52.241414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.242779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.247018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.248863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.256730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 182/352] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:52.257769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.365698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.374391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 171/353] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:52.375442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588d519-21a1-4c70-872d-75472497a119 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.375676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.393867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.413327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.413908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.414182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.414459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.487920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.489395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.496237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0a90e-fa7f-422a-91d2-b51a2b12b8eb None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.561056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.562783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.563440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.564139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.611614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 183/354] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:52.612330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.636921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.668868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.671899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.673147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f97b-b235-4ab2-87fe-f961b4352d12 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.750599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170eae-b5d3-4cb5-9526-903059242b20 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.800177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.801793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.802792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.803572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.805209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.806226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 172/355] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:17:52.809330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.809510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfdae-a44a-4c7e-8a19-9c7d44c37d0f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.809590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 184/356] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:52.809681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfdae-a44a-4c7e-8a19-9c7d44c37d0f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.809681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32abfdae-a44a-4c7e-8a19-9c7d44c37d0f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.809811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.815597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 173/357] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:52.816693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abfdae-a44a-4c7e-8a19-9c7d44c37d0f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:52.919102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.942344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d3ac1-7f89-4a90-814a-7fef85193bc7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.948664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:52.961205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32abfdae-a44a-4c7e-8a19-9c7d44c37d0f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:52.991851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:52.992734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:52.993017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:52.993321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:52.994511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:52.996486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949dc01-799b-4d9b-963d-be8ebbd27efd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:52.998246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 185/358] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.000841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c195-72a4-44f4-a9e2-ca2b9b8e596c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.001135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c195-72a4-44f4-a9e2-ca2b9b8e596c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.001460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0c195-72a4-44f4-a9e2-ca2b9b8e596c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.005547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.006414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.006700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.007350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.015234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.016995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.019026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 174/359] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:52 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.019408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-aad0c195-72a4-44f4-a9e2-ca2b9b8e596c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:53.019797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.020750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-aad0c195-72a4-44f4-a9e2-ca2b9b8e596c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:53.104868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 186/360] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:53.106606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f52a4-c6e5-4069-a0f6-c6fb91613e7e None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.107693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f52a4-c6e5-4069-a0f6-c6fb91613e7e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.107693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f52a4-c6e5-4069-a0f6-c6fb91613e7e None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.108708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 187/361] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:53.109474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f52a4-c6e5-4069-a0f6-c6fb91613e7e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.143173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e7db-88b8-4511-9e26-6f2a384a3425 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.183041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.184181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.184645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.185085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.188360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.190087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 175/362] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.190930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.214413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.224148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.238034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f52a4-c6e5-4069-a0f6-c6fb91613e7e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.275448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27b921-b66a-4537-a3bc-221ff8128e20 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.286769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 188/363] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.287257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.287257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.287257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.305383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:53.306600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:53.311269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d478f970-88a6-453c-b7dc-ff5ddcdef705 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.351053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.351710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.351990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.352264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.353101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=245b589d4dce4345805725887ff002da) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:53.354640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.356590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.362069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 176/364] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=245b589d4dce4345805725887ff002da&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.362874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.394231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 189/365] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:53.396220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.496144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.507381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.519558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af58ba4-1148-48e4-a50a-b7fd339eee3c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.527015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2579e84-050c-45bc-9f03-6470aca893d9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.574873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.576115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.576115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.576115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.581280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.581423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.581528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.581615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.581615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.581615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.581804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 190/366] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.581804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.604965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:53.614365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:53.615292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:53.616098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 177/367] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:53.616784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.713876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562910-c85b-40fe-ac3a-c65a7561b994 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.741223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be550ea-e2e4-44cc-9bc4-a3c97a961a6c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.760044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.761020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.761748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.762029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.762866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=245b589d4dce4345805725887ff002da) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:53.763177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.764605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.772732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 191/368] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=245b589d4dce4345805725887ff002da&role.id=5daf32e946ee47d98d2041330c41a624 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.779066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.793220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c712-f420-430b-a119-974232460a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.795372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c712-f420-430b-a119-974232460a72 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.795627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c712-f420-430b-a119-974232460a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.795911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5270c712-f420-430b-a119-974232460a72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.801862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.810579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5270c712-f420-430b-a119-974232460a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-5270c712-f420-430b-a119-974232460a72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:53.820478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:53.821474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:53.822286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:53.825688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 178/369] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:53.826784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c712-f420-430b-a119-974232460a72 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:53.851464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:53.912816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfa9d5-4d68-4328-b6f7-a137a2bd5572 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.955224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:53.955947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:53.956237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:53.956517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:53.956837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5270c712-f420-430b-a119-974232460a72 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:53.957391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=979caeeeb49c47f284e40be82b0162cc) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:53.957712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:53.959572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:53.966845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 192/370] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:53.967539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.019036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.019642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.020249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.020529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.021630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:54.021938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.023526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.034899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 179/371] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:54.040788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.093650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.141708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee7229-daf8-462c-90ca-9c53847829db None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.189780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.212485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983276c-b8fc-4891-a5c2-93917a16f12e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.215256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.217012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.217012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.217012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.217240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:54.217574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.218969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.238627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 193/372] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:54.244064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.282127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.283294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.283780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.284260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.365839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.367853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.377096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89297f84-1e8c-4f3b-9fed-62ff07b3a4aa None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.461088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.461788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.462055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.462329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.487521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.492978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.493381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 180/373] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:17:54.498779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.623954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec5ad-7ac3-42a4-ab2e-aec91ac92a6d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.628316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.629811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.666072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.667989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.668484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.669426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.670888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.672537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.674847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 181/374] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:54.680394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.737717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.770549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 194/375] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:17:54.776134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.796919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba842e-fb7b-4905-90fb-e2a86d6fc1cf None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.822374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:54.847149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.848382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.848925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.849518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.850938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.852582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.861610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 182/376] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:54.862776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:54.887524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db9f01-7e13-4697-abc8-47d573d70146 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:54.924872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:54.925763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:54.926042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:54.926314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] PATH_INFO: `/v3/projects/924e7efee14f4da6a43ace55813683f0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:54.928220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] RBAC: Authorizing `identity:get_project(project_id=924e7efee14f4da6a43ace55813683f0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:54.929724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:54.937331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 195/377] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/projects/924e7efee14f4da6a43ace55813683f0 => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:54.937861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:55.030684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ae825-9629-40aa-8440-99194591fcb8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:55.044595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afd73-0bd1-4efe-a4cc-1d031d24e960 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:55.053600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:55.069628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:55.080304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:55.081169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:55.081491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:55.081767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] PATH_INFO: `/v3/groups/0a627cc8665e45a09403aeba4055fc25` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:55.089500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] RBAC: Authorizing `identity:get_group(group_id=0a627cc8665e45a09403aeba4055fc25)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:55.091001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:55.097511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 196/378] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/groups/0a627cc8665e45a09403aeba4055fc25 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:55.098811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:55.122081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:55.122761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:55.123047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:55.123322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:55.124176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=979caeeeb49c47f284e40be82b0162cc) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:55.124485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:55.125989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348f26b0-125c-4a58-a7d3-b279fb712625 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:55.143666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 183/379] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:17:54 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=5daf32e946ee47d98d2041330c41a624 => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:55.209056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0303c084-bbf1-4a4e-86ef-efd90ef09fc9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:55.246888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:55.247559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:55.247841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:55.248116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:55.248936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] RBAC: Adding query filter params (group.id=0a627cc8665e45a09403aeba4055fc25, role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=924e7efee14f4da6a43ace55813683f0) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:55.249244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:55.250722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558b719-a088-4048-b88d-f57e0e2b1ed4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:55.259820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 197/380] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:17:55 2022] GET /identity/v3/role_assignments?group.id=0a627cc8665e45a09403aeba4055fc25&scope.project.id=924e7efee14f4da6a43ace55813683f0&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:55.934822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd86f-3811-4a7e-8c87-313745a4ba74 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:55.935863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd86f-3811-4a7e-8c87-313745a4ba74 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:55.936352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fd86f-3811-4a7e-8c87-313745a4ba74 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:55.938367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 184/381] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:55.944095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:55.944936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:55.945641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:55.965614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:55.967230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:56.001596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:56.050104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 198/382] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:56.085834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fd86f-3811-4a7e-8c87-313745a4ba74 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.223455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fd86f-3811-4a7e-8c87-313745a4ba74 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:56.271156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:56.272332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.272822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.273333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.290427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:56.298973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:56.299865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:56.300678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:56.303373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 185/383] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:56.310217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.442752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7053fbb-c167-4730-ae23-cafac6a1a985 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:56.488648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:56.489244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.489547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.489818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.490555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:56.490858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:56.492214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f55f31-692e-428c-8063-b19682ae9d46 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:56.501268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 199/384] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:56.506991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.567360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:56.615051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae421-e489-41f5-ae12-3fd13931bb79 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.615379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae421-e489-41f5-ae12-3fd13931bb79 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.615605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae421-e489-41f5-ae12-3fd13931bb79 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.617238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 200/385] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:56.623116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.623399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.623677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.652742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:56.653969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:56.676857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffdf8-d0f6-421e-a58e-dcb2f5230157 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:56.713073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:56.763914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 201/386] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:17:56.764722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:56.765745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.766027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.766303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.773966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:56.775432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:56.777573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 186/387] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:56 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:56.783260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.787131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.890980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c384c-ad46-4cc1-b62f-00901dbc5c66 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:56.927274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:56.928149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:56.928431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:56.928703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:56.929913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:56.931352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:56.933473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 202/388] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:56 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:56.939060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:56.975159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacc71a-4951-4fe9-b6db-21ed6da02bab None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:56.977525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:56.997981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:57.043858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.044599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.044879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.045153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.064538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:57.072778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:57.075384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:57.077600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 187/389] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:57.085280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.132257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f1946-2256-43a9-9e04-e624b37230c0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.176321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.177749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.178367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.178842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.185720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, group_id=7284b59d862d4a0199eb1c08d51cf3b0, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.187785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:57.221769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfa1017-f590-42ef-bb43-679004dc3586 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.257670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.258414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.258832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.259113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.259855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:57.260686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.262086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:57.270886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 188/390] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:57.278314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.280076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 203/391] 10.222.0.71 () {58 vars in 1442 bytes} [Fri May 27 03:17:56 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:57.321613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:57.434192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ba15d-4997-4cd6-be01-1deeccc6d0b5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.479388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.480255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.480539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.480815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.482454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.483893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27267bcd-497d-40c5-8858-081bb7fbd202 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:57.485856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 189/392] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:57.491422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.564869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f09b-37c7-4db7-9aa9-2331b6385494 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.565498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f09b-37c7-4db7-9aa9-2331b6385494 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.573825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666f09b-37c7-4db7-9aa9-2331b6385494 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.573825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 190/393] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:17:57.575589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.576083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.576570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.592912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:57.596474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:57.597978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:57.626846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26023e20-6d6f-41a7-a830-735bc557b77d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.691386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 191/394] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:57.717891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.721094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.722021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.722427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.722715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.730381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.731880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:57.734016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 204/395] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:57.740421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.821636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:57.850138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bbd69-6f71-46b0-a78a-33b458290145 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.926913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.927724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.928009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.928283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.939452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279007fe-8495-4f22-a67c-b8d401a8db7f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:57.958213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:57.972497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:57.973535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:17:57.974353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 192/396] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:57.986506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:57.987678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:57.988784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:57.989300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:57.989898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:57.992343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=245b589d4dce4345805725887ff002da, group_id=7284b59d862d4a0199eb1c08d51cf3b0, role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:57.994032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f008fe-fe31-468c-af7c-1a2ce7db19c8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.087934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 205/397] 10.222.0.71 () {58 vars in 1442 bytes} [Fri May 27 03:17:57 2022] PUT /identity/v3/projects/245b589d4dce4345805725887ff002da/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/5daf32e946ee47d98d2041330c41a624 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:17:58.095080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccd18-3403-42a2-b645-548c76049b87 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.095080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccd18-3403-42a2-b645-548c76049b87 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.095080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ccd18-3403-42a2-b645-548c76049b87 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.096896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 206/398] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:58.098910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.099490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.099769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.101393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.120944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:58.122737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:58.137005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.138150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135736ee-ae3d-479b-ba9a-7d3a42fe182d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.211221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.212264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.212702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.213126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.214822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:58.218864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:58.222844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.241643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 193/399] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:17:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:58.259253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.286171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 207/400] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:58.336246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.418980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22929281-3fb0-4bea-b1a5-cc092158b5b3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.461955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.463063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.463176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51040b06-8571-4c6c-8f63-e14440e401e5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.463925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.464443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.466786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:58.468417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b943bd-d704-4eda-87a0-86e719c4843c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.470614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 194/401] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:58.472598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c096faa-b87c-406f-98b2-51be8ae31155 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.473090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c096faa-b87c-406f-98b2-51be8ae31155 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.473911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c096faa-b87c-406f-98b2-51be8ae31155 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.476226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 195/402] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:58.477172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c096faa-b87c-406f-98b2-51be8ae31155 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.495812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.508769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.510048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.511276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.511920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.527392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-28185771-0289-4e87-8b11-bd6fb11c2840 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:58.536852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:58.537801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:58.538596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 208/403] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:17:58.539648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.540140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.540498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.549596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.564090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:58.565609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:58.612583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c096faa-b87c-406f-98b2-51be8ae31155 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.656733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.657655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.657987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.658263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.659278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 209/404] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:58.666706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:58.666835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.666912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.666912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 196/405] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:58.669926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.785116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e3486d-3c7b-4338-8123-67f6fe663d90 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.786269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.812670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca763c-81b8-4029-b43f-2e4b2b8c2c6f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.832676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.834089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.834531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.835347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.836238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:58.836692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:58.838777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.840747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:58.856067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 210/406] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:58.857241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:58.858007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:58.859060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:58.859486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:58.859927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:58.863197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, group_id=7284b59d862d4a0199eb1c08d51cf3b0, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:58.864936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:58.965880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6302e81-3137-4a50-b261-a3bfc76eb847 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:58.981297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 197/407] 10.222.0.71 () {58 vars in 1442 bytes} [Fri May 27 03:17:58 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:58.981297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.044118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.044946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.045224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.045540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.069594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:17:59.081871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:17:59.082835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:17:59.083892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 211/408] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:17:59.097511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.188236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b7990-d84f-49bd-856e-7b407fc3aa20 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.214787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:59.246394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.246394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.246394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.246394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] PATH_INFO: `/v3/groups/0a627cc8665e45a09403aeba4055fc25` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.246863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] RBAC: Authorizing `identity:get_group(group_id=0a627cc8665e45a09403aeba4055fc25)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.247613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.252897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 198/409] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:58 2022] GET /identity/v3/groups/0a627cc8665e45a09403aeba4055fc25 => generated 229 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:59.256065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.271450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:59.286369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371f982-1ce8-4588-8de1-0d995bf529ff None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.342493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.343172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.343451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.343721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.344465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:17:59.344765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.346260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.356351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 212/410] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:17:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:59.362720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.433777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10331b37-85e6-4993-abfa-29c16e7cdd8e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.495302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.497840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.498884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.499385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] PATH_INFO: `/v3/projects/924e7efee14f4da6a43ace55813683f0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.503770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] RBAC: Authorizing `identity:get_project(project_id=924e7efee14f4da6a43ace55813683f0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.505514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.507450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 199/411] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:59 2022] GET /identity/v3/projects/924e7efee14f4da6a43ace55813683f0 => generated 344 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:59.514995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.534468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfa4930-7adb-4aeb-941e-3da1212bed0f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.577770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:59.622162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.623389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.623868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.624335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.629996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.631666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.632252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:59.633845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 213/412] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:17:59 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:17:59.640903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.662992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79b79c-ecec-4967-81cd-e23c8058c9ce None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.722042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.722948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.723235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.723513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] PATH_INFO: `/v3/projects/924e7efee14f4da6a43ace55813683f0/groups/0a627cc8665e45a09403aeba4055fc25/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.730037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=924e7efee14f4da6a43ace55813683f0, group_id=0a627cc8665e45a09403aeba4055fc25, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.731502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbca71-9dea-48d1-a0f4-9184e6fd4f66 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.782483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba658dda-1136-45cb-9036-cba40b44f9e2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.814057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 200/413] 10.222.0.71 () {58 vars in 1442 bytes} [Fri May 27 03:17:59 2022] PUT /identity/v3/projects/924e7efee14f4da6a43ace55813683f0/groups/0a627cc8665e45a09403aeba4055fc25/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:17:59.815752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd704d-3b2c-45e6-b613-230b0e2bbc99 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.816051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd704d-3b2c-45e6-b613-230b0e2bbc99 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.816402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd704d-3b2c-45e6-b613-230b0e2bbc99 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.818454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:17:59.819422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.819764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.820047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.821362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:17:59.822533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 201/414] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:17:59.823642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:17:59.824953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:17:59.825250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:17:59.825552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:17:59.825860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 214/415] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:17:59 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:17:59.832612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:17:59.848799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:17:59.850642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:17:59.897718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:17:59.951265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 202/416] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:17:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:17:59.959251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcbf78-806b-4dbc-a0f6-1ac2abd3a350 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:17:59.980295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.035411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.036235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.036515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.036786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.043913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] RBAC: Authorizing `identity:create_grant(project_id=979caeeeb49c47f284e40be82b0162cc, group_id=7284b59d862d4a0199eb1c08d51cf3b0, role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:00.045559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:00.061674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:00.101479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98475f95-414f-4ed5-bbdf-eadff5b2a70f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.131436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 215/417] 10.222.0.71 () {58 vars in 1442 bytes} [Fri May 27 03:17:59 2022] PUT /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc/groups/7284b59d862d4a0199eb1c08d51cf3b0/roles/5daf32e946ee47d98d2041330c41a624 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:18:00.159691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.160513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.160804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.161112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.174164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:00.188909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:00.190304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:00.191118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 203/418] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:17:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:00.196105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.309986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-9569-471d-973e-c4938379406d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.325383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:00.351922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.352597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.352881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.353153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.354843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] RBAC: Adding query filter params (name=member) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:00.355248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:00.356734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0704c287-1c35-4670-a1af-36918450e79f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:00.366997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 216/419] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:00.373288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.501904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daa88-a06d-4f3c-be2c-b85200d94d5b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.543657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:00.552956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.553652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.553971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.554263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.651788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5b26-89c5-4324-8e2e-901f192bf452 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.652139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5b26-89c5-4324-8e2e-901f192bf452 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.652346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f5b26-89c5-4324-8e2e-901f192bf452 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.653799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 217/420] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:00.654569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:00.656126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:00.659043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.659338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.659619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.676955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:00.678505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:00.782584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 218/421] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:00.808439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 204/422] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:00.813702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.817524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.847427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:00.927441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7062c7a0-ca49-4964-9fb5-ff24c5adebe9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.964938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:00.965778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:00.966063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:00.966339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:00.977232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:00.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:00.986674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:00.987934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 205/423] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:00.988849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94490afe-436d-4436-815b-f35c988e21d0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:00.992821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:00.996604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.050009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.050885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.051174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.051451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.052659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.054144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.065613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 219/424] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:01.066478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:01.082612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.098384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895525ea-ff9a-4948-a3e1-914a4be214ba None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.138576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.139249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.139531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.139804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.140554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:01.140861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.142264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.156029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 206/425] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:01.161419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:01.224484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75518c9-5ceb-40f3-b798-cd645684832e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.269608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.270489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.270767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.271039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.278037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.279690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.281748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 220/426] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:01.286891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:01.298338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970fb63-423c-4bd9-b60a-e81bb1e408c7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.343099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.357992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.357992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.357992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.357992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.398920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.411109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924dc90-a86a-4085-b4ac-24bb390bac16 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.459319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.459987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.460275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.460552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.461411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=245b589d4dce4345805725887ff002da) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:01.461726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.463249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.480122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 221/427] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=245b589d4dce4345805725887ff002da&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:01.480893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.482407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.593522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 207/428] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:18:01.599480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:01.716632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad3c15-2992-4f04-9404-9dc011678ac0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.723962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.770035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.770839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.771118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.771394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] PATH_INFO: `/v3/projects/245b589d4dce4345805725887ff002da` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.775044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] RBAC: Authorizing `identity:get_project(project_id=245b589d4dce4345805725887ff002da)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.776772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.778536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 222/429] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/projects/245b589d4dce4345805725887ff002da => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:01.784583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:01.841120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:01.910779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265814fb-ab3e-4b62-80ed-6b17512304c7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:01.949653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:01.950513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:01.950791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:01.951119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:01.952287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:01.953757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaa749e-eedf-496b-ac36-7efd99afe37e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:01.955678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 208/430] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:01.962003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.070202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd5ed8-00e5-4b8a-b359-af0fdf0c71c6 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.076042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2ef8-3004-476f-aed7-5d0acf9cd526 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.076308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2ef8-3004-476f-aed7-5d0acf9cd526 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.076589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2ef8-3004-476f-aed7-5d0acf9cd526 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.078263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 209/431] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:02.083331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.083873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.084152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.104359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:02.106046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:02.109611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.110277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.110557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.110827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.111647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=245b589d4dce4345805725887ff002da) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:02.111953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:02.113411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:02.120559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 223/432] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:18:01 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=245b589d4dce4345805725887ff002da&role.id=5daf32e946ee47d98d2041330c41a624 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:02.179711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 210/433] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:02.214232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.264503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:02.341992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22531e0-df3e-4eb3-a21b-bf4d7b24beb6 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.385923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.386730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.387014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.387286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.400191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:02.408443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:02.410740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:02.412668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 224/434] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:02.419484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.480296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:02.555260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241f120-94d3-418e-9e36-c7aa9e9e16fe None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.594894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.595488 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.595767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.596034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.596775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:02.597075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:02.598479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617af2ac-08c5-4c1b-baab-ecbc7e9089eb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:02.608110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 211/435] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:02.613534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.675861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cfe08-32dd-42e8-b02b-9884ea860077 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.676184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cfe08-32dd-42e8-b02b-9884ea860077 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.676551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513cfe08-32dd-42e8-b02b-9884ea860077 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.678621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 212/436] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:02.683596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.683808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.684086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.707271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:02.709204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:02.727432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:02.732664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9239c36-2002-4622-b4fd-d28e11ebfe83 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.774154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.774820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.775104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.775386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.803057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 213/437] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:02.826811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.849311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:02.850697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee996496-5d4c-45eb-9889-e62eadb545d6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:02.867047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:02.932512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0887d8f-fbbb-4287-a573-69785836f83f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:02.952438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:02.961510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 225/438] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:02.962794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf17f7-2a77-40b9-8a89-9b138eb7e4db None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.963126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf17f7-2a77-40b9-8a89-9b138eb7e4db None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.963398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf17f7-2a77-40b9-8a89-9b138eb7e4db None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.964707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 226/439] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:02.965426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf17f7-2a77-40b9-8a89-9b138eb7e4db None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:02.971374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:02.972173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.972450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.972724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:02.983522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-b8117ac8-e351-400e-a7bd-e0f9935104c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:02.991200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:02.992075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:02.992865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 214/440] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:02.993951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:02.994796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:02.995046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.011647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:03.012814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:03.069847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf17f7-2a77-40b9-8a89-9b138eb7e4db None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.079281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 215/441] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:03.080174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.107544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.107732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.108328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.108606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.108879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.110065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.111495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.113148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 227/442] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:18:02 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.113921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.178282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ccda-618f-4f19-92c2-4ce0015905c6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.180338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.212884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.213778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.214067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.214346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.215089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:03.215394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.215883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ae61-686b-43f8-b3e7-0aff909f1bb4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.216782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.224870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 216/443] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.225615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.249997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.250820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.251110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.251386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.262911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:03.270938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:03.272279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:03.273081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:03.277481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 228/444] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:03.278522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.316126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.326279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2673c-56d2-4c39-b457-0b3cd8dfbcbc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.360486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.361289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.361575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.361873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.363149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.364597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.366291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 217/445] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.367045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.379736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5697af-de6a-4ecf-8010-a26b47aaf77c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.404916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.413140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.413895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.416674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.416674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.469630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28032dc-fbb4-4dc4-b639-17aa0ab4e234 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.482758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.484212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.502518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.503181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.503463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.503745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.504479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:03.504779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.506157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.514450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 218/446] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.515225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.538323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.586702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 229/447] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:03.587832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.614733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.616728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97934213-9065-4ed6-b8ad-a37ffa07de38 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.652191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.652878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.653166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.653475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.654303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c, scope.project.id=979caeeeb49c47f284e40be82b0162cc) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:03.654617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.656051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.661903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 219/448] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.662735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.690426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bee12-9afc-4dfe-8841-97eab11d3020 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.728784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.730208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.730503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.730789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.769024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.787618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d2a3-ad15-4f66-bc4d-348d7d4c43d0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.813540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.815061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.829822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.830843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.831244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.831521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] PATH_INFO: `/v3/projects/924e7efee14f4da6a43ace55813683f0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:03.832776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] RBAC: Authorizing `identity:get_project(project_id=924e7efee14f4da6a43ace55813683f0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:03.834525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:03.841637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 220/449] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/projects/924e7efee14f4da6a43ace55813683f0 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:03.842815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.846865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:03.937295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 230/450] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:03.942876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:03.960898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f403f3e-f85a-4297-9ef1-c145b82c5b27 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:03.998457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:03.999324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:03.999614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:03.999891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] PATH_INFO: `/v3/groups/0a627cc8665e45a09403aeba4055fc25` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.001107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] RBAC: Authorizing `identity:get_group(group_id=0a627cc8665e45a09403aeba4055fc25)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:04.002668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:04.004318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 221/451] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/groups/0a627cc8665e45a09403aeba4055fc25 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:04.010874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:04.036282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:04.068702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45145328-877a-45ad-8d88-a5e369284e1e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:04.095016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:04.103833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:04.104688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.104974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.105271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] PATH_INFO: `/v3/projects/979caeeeb49c47f284e40be82b0162cc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.106463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] RBAC: Authorizing `identity:get_project(project_id=979caeeeb49c47f284e40be82b0162cc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:04.107943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:04.109693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 231/452] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:18:03 2022] GET /identity/v3/projects/979caeeeb49c47f284e40be82b0162cc => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:04.115076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:04.123028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327f793-544d-42cd-ac46-33fb8739f135 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:04.157376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:04.158043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.158308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.158583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.159404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] RBAC: Adding query filter params (group.id=0a627cc8665e45a09403aeba4055fc25, role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=924e7efee14f4da6a43ace55813683f0) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:04.159715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:04.161147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:04.167035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 222/453] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:18:04 2022] GET /identity/v3/role_assignments?group.id=0a627cc8665e45a09403aeba4055fc25&scope.project.id=924e7efee14f4da6a43ace55813683f0&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:04.221899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911ed75-aedf-48d8-8f19-475334577f65 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:04.257855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:04.258726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.259015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.259408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] PATH_INFO: `/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.261376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] RBAC: Authorizing `identity:get_group(group_id=7284b59d862d4a0199eb1c08d51cf3b0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:04.262869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d83561-ea7e-4076-a488-5553e88f8f97 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:04.264544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 232/454] 10.222.0.71 () {56 vars in 1180 bytes} [Fri May 27 03:18:04 2022] GET /identity/v3/groups/7284b59d862d4a0199eb1c08d51cf3b0 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:04.270676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:04.357721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:04.374530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364214e4-99be-419c-8815-769f6e5b2940 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:04.409428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:04.410085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:04.410366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:04.410640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:04.411502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] RBAC: Adding query filter params (group.id=7284b59d862d4a0199eb1c08d51cf3b0, role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=979caeeeb49c47f284e40be82b0162cc) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:04.411815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:04.413240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efed91-1082-455b-a816-c07ba8d217ac None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:04.418963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 223/455] 10.222.0.71 () {56 vars in 1376 bytes} [Fri May 27 03:18:04 2022] GET /identity/v3/role_assignments?group.id=7284b59d862d4a0199eb1c08d51cf3b0&scope.project.id=979caeeeb49c47f284e40be82b0162cc&role.id=5daf32e946ee47d98d2041330c41a624 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:07.246448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97f94-2a6a-4d0b-b13a-4c4d06e93608 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.246960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97f94-2a6a-4d0b-b13a-4c4d06e93608 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.247037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db97f94-2a6a-4d0b-b13a-4c4d06e93608 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.248370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 233/456] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:07.254112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612afe6-ab6a-415a-b78e-64d9308cd0ef None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.254953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612afe6-ab6a-415a-b78e-64d9308cd0ef None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.255456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612afe6-ab6a-415a-b78e-64d9308cd0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.282290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f612afe6-ab6a-415a-b78e-64d9308cd0ef None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:07.283889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f612afe6-ab6a-415a-b78e-64d9308cd0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:07.377709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 224/457] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:07.416662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97f94-2a6a-4d0b-b13a-4c4d06e93608 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:07.497724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:07.550275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a262-d2ad-419d-b3cb-c43d07dde752 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.550953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a262-d2ad-419d-b3cb-c43d07dde752 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.551432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a262-d2ad-419d-b3cb-c43d07dde752 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.553225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 225/458] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:07.557447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db97f94-2a6a-4d0b-b13a-4c4d06e93608 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:07.559450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.559977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.560458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.596988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:07.597816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.598098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.598370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.606361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:07.607683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:07.610947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:07.612561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:07.645944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:07.647020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:07.648043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:07.648043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:07.648043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:07.648043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:07.649967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 234/459] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:07.656743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:07.691760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 226/460] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:07.718661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:07.730074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:07.872451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acda178-1b0d-4293-8586-38042ac509d5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:07.891299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:07.895368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c5e08-d1a2-466e-afa4-f1ab905d6c26 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:07.914635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:07.915507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.915795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.916588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.917355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:07.917784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:07.919271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca86bdc-c8f6-4ee2-aa5f-f30513c1f98a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:07.934045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 235/461] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:07.935739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271587-03e3-4731-adc3-b1fc9fcf8c43 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.936218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271587-03e3-4731-adc3-b1fc9fcf8c43 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.936732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba271587-03e3-4731-adc3-b1fc9fcf8c43 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.938812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 236/462] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:07.939680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271587-03e3-4731-adc3-b1fc9fcf8c43 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:07.949031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:07.950253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.950742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.951195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:07.963325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:07.965145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-41874690-4c73-4b85-beb4-d1f59ddbb3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:07.984634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:07.985581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:07.986419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:07.986419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:07.986419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:07.986419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:07.988774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 227/463] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:07.990553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:07.991054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:07.991540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.016311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:08.017906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:08.053500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba271587-03e3-4731-adc3-b1fc9fcf8c43 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.093522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.094478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.094905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.095367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.096046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.097493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.099109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.113399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 228/464] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:08.114745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.188606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 237/465] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:07 2022] POST /identity/v3/users => generated 246 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:08.194721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.244691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8681bfa-629f-481d-aa44-3c2287fbd105 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.250421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.292939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.294599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.295111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.295583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.296585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:08.297143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.298779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94530b6e-c547-4ced-8473-4b1539610be4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.317789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 229/466] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:08.319683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c28f8-b9c6-4a46-ad54-93517001951e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.320176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c28f8-b9c6-4a46-ad54-93517001951e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.320664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c28f8-b9c6-4a46-ad54-93517001951e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.322385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 230/467] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:08.323545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c28f8-b9c6-4a46-ad54-93517001951e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.343921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe4f90-8b76-4bd3-a4cc-e0b95817d535 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.380896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.381856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.382145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.382421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.384142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.394801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.396281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fba34fcc-e2b1-455b-ad38-287c4418485c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:08.415393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:08.417084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:08.418146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:08.418146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:08.418146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:08.418146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:08.418380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 238/468] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:08.420978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.421402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.421684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.440051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:08.441337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:08.447030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c28f8-b9c6-4a46-ad54-93517001951e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.493044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.493914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.494319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.494810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.495806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.498380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.539652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 239/469] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:08.540524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.556056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.602163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 231/470] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:08 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:08.609546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.660044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2f2e4-e82f-406b-94f9-3bb2fb0ac602 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.710700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.711599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.711891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.712167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.713313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:08.714166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.715873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730636a8-f8bc-437e-b7b3-4c07da423037 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.732201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 240/471] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:08.734610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2509-938f-4703-8e1c-8c48e9778140 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.734900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2509-938f-4703-8e1c-8c48e9778140 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.735180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b2509-938f-4703-8e1c-8c48e9778140 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.740825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 241/472] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:08.741792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2509-938f-4703-8e1c-8c48e9778140 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:08.769024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c14c88-2361-402c-9a84-26febbc34346 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.777992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.817251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.819218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.819753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.820423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.834062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:08.837576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.840097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-fad196ea-c899-42e4-8d60-9a9dac8c7a5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:08.859415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:08.860516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:08.861468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:08.861468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:08.861468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:08.861468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:08.861468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 232/473] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:08.862457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2abf-481c-4395-a855-881394850649 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.862457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2abf-481c-4395-a855-881394850649 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.862756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a2abf-481c-4395-a855-881394850649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.882755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b2509-938f-4703-8e1c-8c48e9778140 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:08.882966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-908a2abf-481c-4395-a855-881394850649 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:08.884053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-908a2abf-481c-4395-a855-881394850649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:08.927052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:08.927724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:08.928009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:08.928285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:08.928983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:08.930510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:08.970945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 233/474] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:08.971804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a2abf-481c-4395-a855-881394850649 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.057730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 242/475] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:08 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:09.058969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.112034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:09.138148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a2abf-481c-4395-a855-881394850649 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.213171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.215251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.216698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.217173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.218116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:09.218757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:09.221823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:09.235085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 234/476] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:09.241052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.302474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1207c9-51e5-414a-9be6-e39019cdc89d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.337764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:09.346013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.350903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.350903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.350903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.350903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:09.350903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:09.364439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d038af-4dfb-45f0-a8b3-0455181454a9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.404397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.405065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.405376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.405652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.406351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:09.407862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:09.410272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.sql.core [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:18:09.410272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 03:18:09.410272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [parameters: {'id': 'fb22e60aceda4385a046bb3a58b3e5e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 03:18:09.410272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application conn.query(q) May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result.read() May 27 03:18:09.427822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return ref.to_dict() May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:18:09.428761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application next(self.gen) May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application yield resource May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application next(self.gen) May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise self.value May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application session.commit() May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:18:09.429723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.session.flush() May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application compat.raise_( May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:18:09.430567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:18:09.431485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application conn.query(q) May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result.read() May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:18:09.436928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [parameters: {'id': 'fb22e60aceda4385a046bb3a58b3e5e9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:09.438102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 27 03:18:09.439150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.440019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 243/477] 10.222.0.71 () {60 vars in 1131 bytes} [Fri May 27 03:18:09 2022] POST /identity/v3/roles => generated 144 bytes in 373 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:09.441017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.526374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 235/478] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:09 2022] POST /identity/v3/users => generated 249 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:09.559256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e81bc4-332d-432c-926a-7e6465b71bae None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.611729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.612859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.613378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.613846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.630809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fdee1d92-96f0-4256-b0c5-ae4f20a09617 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:09.640208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:09.641453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:09.642258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 244/479] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:09.648373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:09.654578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:09.787639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd58693-d215-41bf-b353-5a7358318b2d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:09.823133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:09.823811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:09.824091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:09.824366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:09.825118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:09.825447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:09.826817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f212a-e848-4481-9cb5-a8c3b22a24c8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:09.836722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 236/480] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:10.806526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364265-d3f8-4903-8bb4-cd1ad42d7f96 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:10.807257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364265-d3f8-4903-8bb4-cd1ad42d7f96 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:10.807257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c364265-d3f8-4903-8bb4-cd1ad42d7f96 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:10.808436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 245/481] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:10.813864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:10.814261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:10.814447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:10.836579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:10.838409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:10.923813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:10.935812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 237/482] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:10.985495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364265-d3f8-4903-8bb4-cd1ad42d7f96 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.056129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:11.118934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c364265-d3f8-4903-8bb4-cd1ad42d7f96 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:11.161936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:11.162736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.163021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.163298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.182505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-66055943-df4a-48ff-9c0c-48c9f445d556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:11.190260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:11.191128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:11.191939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 246/483] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:11.199047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.333323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8c54b-3fab-4374-9d72-d38ad99a4732 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:11.371602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818746a-5ce8-498a-b4e8-d3e8f71fdb43 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.371891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818746a-5ce8-498a-b4e8-d3e8f71fdb43 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.372076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818746a-5ce8-498a-b4e8-d3e8f71fdb43 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.373478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 247/484] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:11.388744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:11.388947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.388947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.388947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.389136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.389136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.389285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.390047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:11.390353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:11.393084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:11.413373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 238/485] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:11.419579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:11.420807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:11.424057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.513915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 248/486] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:11.547457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.598045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:11.601581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:11.686466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731337d4-20b9-4612-b1a1-c9be9902e643 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:11.713785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078af17-5c11-4ecc-9974-c60817eaecc0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:11.751923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:11.752729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.753002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.753425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.766771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:11.778669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:11.779569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:11.780382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:11.783196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 249/487] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:11.784348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:11.785157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:11.785492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:11.785772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:11.787104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.814241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:11.815701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:11.846328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:11.847268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:11.848114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:11.848114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:11.848114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:11.848114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:11.848328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 239/488] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:11.855294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:11.983421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6e9bc-4afb-4c96-a3c4-ca00ab9c483c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.005284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.009657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64c519-fd8c-4f0d-84b5-0a44cc6c8c71 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.021616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.049074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.049780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.050068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.050369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.051529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:12.051843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.053446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.067965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 240/489] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:12.071042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.071917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.073486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.074557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.074839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.075634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:12.075951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.077397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf36e8-8fbe-4b0d-a4b2-6c1741558525 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.093684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 250/490] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:12.095070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7b4b-ee98-4a44-b58b-646da80aaf84 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.095363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7b4b-ee98-4a44-b58b-646da80aaf84 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.095642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7b4b-ee98-4a44-b58b-646da80aaf84 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.100805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 251/491] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:12.101573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd7b4b-ee98-4a44-b58b-646da80aaf84 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.217171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9457a-dfea-445d-97d2-02d4bb66f3e3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.225760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd7b4b-ee98-4a44-b58b-646da80aaf84 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.262658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.263545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.263935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.264317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.265409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.266418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.266772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.267232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.272577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.274501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.278848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.280369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-440c618a-ccb6-4905-b5f9-bb968a528eff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:12.294152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:12.296064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 241/492] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.298293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.299900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:12.309284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:12.311341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 252/493] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:12.313168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.315560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:12.316763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:12.329969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.350749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.421334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 242/494] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:12.422160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.453403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ded21-bf50-4691-ab76-c07ffc9a7c62 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.496389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.497161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.497537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.497948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.499021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:12.499397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.501001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.545283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98aaa-e7db-4cc4-bfea-e944f45ff71a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.545470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 253/495] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:12.545470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.582379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.582657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.582941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.583221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.584203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:12.584511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.585940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.601301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 243/496] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:12.601301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.622249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.625327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.650050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e809b1fe-cf34-4895-a240-a2bacdeea80f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.683669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.684469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.684749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.685034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.695523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:12.699265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca801e-16b8-4baf-ad44-9f2ed4c51db6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-454f31c1-c270-4405-81e4-9644c2c970ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:12.703228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:12.704372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:12.705171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 254/497] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:12.705929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7190-7fc6-4b75-9705-009c6c709242 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.705996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7190-7fc6-4b75-9705-009c6c709242 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.706229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc7190-7fc6-4b75-9705-009c6c709242 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.707679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 255/498] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:12.708930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184224e-b78a-423b-9303-3d32f11b4493 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.709286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184224e-b78a-423b-9303-3d32f11b4493 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.709556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184224e-b78a-423b-9303-3d32f11b4493 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.715398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 256/499] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:12.715398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184224e-b78a-423b-9303-3d32f11b4493 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:12.739272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.739917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.740203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.740477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.807195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.808575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ddc9c-be7a-4127-a297-3c0e6de2e2ad None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.814468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184224e-b78a-423b-9303-3d32f11b4493 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:12.828511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.848311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:12.849173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.849481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.849756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.851679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:12.858042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:12.859486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-928407c4-c325-43f4-b25e-f8eb0550c8f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:12.875111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:12.876233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:12.877162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 257/500] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:12.878229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda56b-e4f7-482c-999e-200406658571 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.878229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda56b-e4f7-482c-999e-200406658571 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.878393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eda56b-e4f7-482c-999e-200406658571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.896220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-54eda56b-e4f7-482c-999e-200406658571 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:12.897464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-54eda56b-e4f7-482c-999e-200406658571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:12.910123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 244/501] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:12.911392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:12.911680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:12.911952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:12.927419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:12.928585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:12.969206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 258/502] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:12.970285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eda56b-e4f7-482c-999e-200406658571 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.018673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 245/503] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:13.019989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.078059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.091392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eda56b-e4f7-482c-999e-200406658571 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.114966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.125831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.126496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.126781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.126995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c1aae3-ef10-4be5-8c4b-bc9b639b37cd None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.127090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.127789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:13.128135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.129595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.137579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 259/504] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:13.138379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.162982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.163652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.163933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.164209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.165039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:13.165376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.167465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.204103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 246/505] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:13.205017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.238636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572cf9a0-9855-4f59-95b5-a2079549129d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.279389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.280196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.280470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.280753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.291976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.293461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.310085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3bab4-aa9e-4ea8-9063-8738071f244d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:13.311199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:13.312072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:13.312919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:13.312919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:13.312919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.312919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:13.312919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 260/506] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:13.313191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.323731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.348628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.349395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.349683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.349960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.351782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.360840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:13.369224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:13.370346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 247/507] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:13.371151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.415080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9014cb-8e4f-4613-a866-5fa67d5b7794 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.448006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.448799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.449203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.449359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.459447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.460882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.477108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a77b68-401e-4941-87f9-0d301ed769c4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:13.478852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:13.479888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 261/508] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:13.480745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.514369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.515155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.515435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.515709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.527016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.528478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:13.546818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:13.547702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:13.548556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:13.548556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:13.548556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:13.548556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:13.548556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 248/509] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:13.549246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.572711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.574715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.584557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841dd51-3ec7-4eff-b34e-6143c6f7e82e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.619426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.620101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.620378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.620657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.726346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe0501-5398-428c-853d-8c27e21b52cf None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.758698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.759991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.760361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.760539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.760693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.761451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:13.761760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.762006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.763124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.775840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 249/510] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:13.776764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.854122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.856718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:13.864132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 262/511] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:13.864939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.875749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d7a38-4aff-4cbf-8ec6-a18629dbb3a5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.910181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:13.915131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:13.921620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 250/512] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:13.922402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:13.964634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec0806-8a61-4ce4-a73b-5f80f247191b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:13.999014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:13.999682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:13.999972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.000256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.000964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.001291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.002707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.014307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 263/513] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.015092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.027404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0af86-44ef-498a-a50b-a243ff4f2cbe None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.060576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.061237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.061551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.061829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.062544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.062848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.064210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.065722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.076594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 251/514] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.077415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.079952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.122349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb333-4aa2-4893-816f-582165c5fdc0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.155652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.156363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.156645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.156918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.163323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.164758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.175126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf7a77-280b-4c25-affd-b41713de57f7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:14.179278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:14.180207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:14.181038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 264/515] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:14.182160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.214836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.215626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.215910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.216190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.226118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.227579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:14.245470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:14.246368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:14.247215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:14.247215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:14.247215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:14.247215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:14.247215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 252/516] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:14.247494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.285222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6322b1-4a53-446a-b245-7003c11fdbca None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.296285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.304377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.318649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.319439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.319720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.319993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.331051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.334613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.347767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d7806-9f5a-4289-91b5-ba527b3fedb2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:14.349854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:14.350785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:14.351625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:14.351625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:14.351625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:14.351625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:14.351625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 265/517] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:14.351901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.382858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.383520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.383803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.384077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.385015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.386505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.451115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c78376-4d2d-4dd6-823d-bdb8c001f65c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.474454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 253/518] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:14 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:14.475287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.491633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.492465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.492755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.493030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.502121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.503604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:14.520311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:14.521551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:14.522455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:14.527049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 266/519] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:14.528053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.557731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.620017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28e124-d8c0-4fd3-b909-7f0a5ad55792 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.631983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.642740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084cc45-cae0-4a1b-928d-697f3030ec6b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.660464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.661138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.661453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.661729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.662521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.662828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.664294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.680950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.681690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.687056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.687056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.687056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.687056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.687339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 254/520] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.687339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.687481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.698987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 267/521] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.699840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.791287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.800657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad86041e-2b98-4e46-83bf-cc65cd218735 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.811856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ed9d-e4f7-4175-bb7e-4ca5f566a2dd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.837322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.838409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.838713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.838993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.839718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.840027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.841440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.849192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:14.849847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:14.850133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:14.850411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:14.851516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:14.851516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:14.853229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:14.855453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 255/522] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.860390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.872687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 268/523] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:14.874172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:14.893684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:14.965624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa242c8-77af-404a-858e-fc8df3aa791e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:14.990366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a84a8c-f683-408f-acf2-69e81b46c547 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.003909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.004564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.004848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.005123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.005990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:15.006398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.007838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.021294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 256/524] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:15.021294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.039689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.040820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.041211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.041684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.049983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.051632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:15.067711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:15.068644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:15.069499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 269/525] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:15.070042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.075527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.161332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.172467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4098e14-a02e-46bc-b887-cafb9f4b27b1 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.201613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b208075-6bef-4a44-9058-c80fbcf7d1df None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.224650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.226101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.226388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.226666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.237331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.239281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.241727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.242475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.242835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.243275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:15.257920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:15.258882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:15.260441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:15.267906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 257/526] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:15.267906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.333044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.335415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.394964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d3eae-e906-4294-8a91-109e32543a0e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.425505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.436407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.437151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.437423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.437947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.438473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:15.438778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.440216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.445648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 270/527] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:15.447220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.454022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 258/528] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:15.454859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.471415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.563600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac88c0-7bf4-4bc0-8276-e9165174bdca None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.566881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb6f54-8f62-4c45-8dc5-e33736f0b58b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.589714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.602241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.603916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.604407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.604714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.605176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.605548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.605828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.606101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.606879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:15.607400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.609313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.616819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.618305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.633908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 271/529] 10.222.0.71 () {56 vars in 1139 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:15.635713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:15.637851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:15.641635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 259/530] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:15.642508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.710322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.746798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab685f5-e004-4737-8b20-7b933195fe88 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.753030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f769c-b382-4610-87b0-9bf2d4fc4718 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:15.782500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.783294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.783644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.783988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.791832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:15.792749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:15.793352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:15.793851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:15.794875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=6ce376ecc47a48c1bac3a5231d09c91c) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:15.795410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.797193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.809634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 272/531] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/role_assignments?user.id=6ce376ecc47a48c1bac3a5231d09c91c&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:15.811043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:15.859191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:15.860659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:15.863124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.929032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:15.976644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 260/532] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:15.986219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.002675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dae357-9bcf-4dbf-86c8-8fa91ea67052 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.067128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.068188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.068692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.069197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.070142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:16.070664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.072471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.099450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 273/533] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:16.105281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.156128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860deda1-d5b0-4956-9a7e-bd0cfe10446c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.223615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.224470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.224758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.225034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.240529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.242213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.246608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:16.263796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:16.270292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:16.271144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:16.271144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:16.271144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:16.271144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:16.271144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 261/534] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:16.272663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.292150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac42bf-41fe-49d0-9f41-b7160ac5607d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.324316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:16.369895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.370727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.371013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.371291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.386424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.387866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:16.416693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:16.417708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:16.418550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:16.420025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 274/535] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:16.428913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.479923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d7d28-5421-49d1-8978-eb4e1f7d854e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.578951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765885-3442-4cdd-8cdb-4666cb4928c1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.584509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.585180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.585484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.585756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.586476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:16.586777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.593767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.616967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 262/536] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:16.619136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.651177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.653214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.654303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.654303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.654860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:16.655179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.656692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.692873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 275/537] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:16.719903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.733624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:16.770052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:16.794828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63d72-e1c4-4063-96e2-f6f904206fee None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.854528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.855338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.855622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.855899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.874057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.875535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-f97b5c89-43ea-4d5d-b121-b897306f13d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:16.899361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:16.900296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:16.901136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 263/538] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:16.906357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937414c-fda3-4373-a438-d4a507806248 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.906650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937414c-fda3-4373-a438-d4a507806248 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.906961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937414c-fda3-4373-a438-d4a507806248 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.908504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 264/539] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:16.909922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937414c-fda3-4373-a438-d4a507806248 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:16.919207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9946f-5f3d-43cc-81d2-97a8d1ab833e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:16.967050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:16.967849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.968516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.968798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:16.969672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=5b23f15e3a064cd7b7cb6c100004a111) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:16.969982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:16.971943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffcdae-4670-4593-b6f2-8341fcb16589 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:16.980718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 276/540] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/role_assignments?user.id=5b23f15e3a064cd7b7cb6c100004a111&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:16.982227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:16.982516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:16.982791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.002699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:17.003930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:17.080906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:17.092585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 277/541] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:17.100418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937414c-fda3-4373-a438-d4a507806248 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.119380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.187783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.188450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.188735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.189013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.189828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:17.190136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:17.191576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:17.207024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:17.224027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 265/542] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:17.230671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.248789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dece81-93a4-42db-8361-9427be0b5cdd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.294890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.296262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.296704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.296991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.310156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:17.321242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:17.323644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:17.325570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 278/543] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:17.334971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.367706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff2cd1-35e6-42cc-9a70-f95138bb6f9d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.403870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.404538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.404833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.405109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.405986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=b4c5841ec0bd4e16b90e6b1c42ff0df1) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:17.406313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:17.407917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8eb88c-2467-4b89-8434-daf8c32a6125 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:17.414283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 266/544] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/role_assignments?user.id=b4c5841ec0bd4e16b90e6b1c42ff0df1&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:17.453289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:17.512767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8dca3-8862-40e8-a4b2-dd54da7b3c8b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.513007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8dca3-8862-40e8-a4b2-dd54da7b3c8b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.513279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8dca3-8862-40e8-a4b2-dd54da7b3c8b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.514691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 267/545] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:17.523180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.523476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.523747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.559990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:17.561294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:17.571427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3384d8ab-58ab-4d32-a7cd-ab4b6e08f1cc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.633292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:17.636630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.637657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.638309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.638856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.639814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:17.640310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:17.644944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 268/546] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:17.645073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:17.659070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 279/547] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:17.666950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.677357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.801693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420ad9a-35cb-4ac3-9811-2952f7093328 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.814448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0a215-15a1-49d1-865b-6601152f89b4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:17.840392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.841559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.841989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.842429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.854070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:17.855777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:17.862353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:17.876382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:17.877833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:17.879458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:17.879458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:17.879458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:17.879458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:17.881324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 269/548] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:17.889461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.904964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:17.905802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:17.906093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:17.906366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:17.926596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:17.938206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:17.939378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:17.940191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 280/549] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:17.946387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:17.971584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.071808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd25e0-800a-4e7f-8f4e-f754efaafafe None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.121846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.122971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.123321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.123639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.124517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:18.124824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.126327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.147299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70357b-d8a8-4a04-9007-32db8e1d2baa None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.155020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 270/550] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:18.160976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.189151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.189859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.190129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.190402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.191153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:18.191458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.192841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.206775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 281/551] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:18.208010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.252524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.302545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cc492-173d-4a6c-93a0-080767e293c9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.304959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.312029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d73c00b-92c5-45d7-8c8c-76608108feeb None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.340586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.341702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.341997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.342266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.347254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.348060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.348344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.348621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.349955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.351761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.360498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.361975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-0a17ca2c-7567-4613-a258-a22f60c41e98 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:18.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:18.369941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 271/552] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c7d6-e730-4386-886a-7b8c65ee562f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.372727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c7d6-e730-4386-886a-7b8c65ee562f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.374444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8c7d6-e730-4386-886a-7b8c65ee562f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.378339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 272/553] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:18.379103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c7d6-e730-4386-886a-7b8c65ee562f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-74ec5150-14ce-4c3b-a224-84334b742dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:18.390744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:18.391641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:18.392527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:18.392527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:18.392527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:18.392527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:18.394726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 282/554] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:18.396187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.396697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.397247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.414696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:18.417332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:18.494542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 283/555] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:18.497324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8c7d6-e730-4386-886a-7b8c65ee562f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.502300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.543873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.544562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.544849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.545126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.545990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:18.546299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.547740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.551102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.572567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 273/556] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:18.573691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.600917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.648232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51d6ee-f412-4dcd-96f9-abb2a594b67d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.683200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859de4d-cb36-47e7-a81f-b7d29e3e0661 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.686882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.687802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.688313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.688816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.689921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:18.690444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.692004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.704689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 284/557] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:18.705799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.719305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.720113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.720395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.720670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.732510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:18.740272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:18.741929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 274/558] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:18.744180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:18.823721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.836366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:18.849779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bddcc4-5af0-4c24-9188-1c9e248b1ed4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.857533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b054188-10c4-4207-a13b-4672ad02492d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:18.895541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.896920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.896920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.896920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.907397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:18.909297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:18.912442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:18.913758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:18.914199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:18.914639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:18.925974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:18.927166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:18.928546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 275/559] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:18.930229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.023368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.025631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.041929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb7273-0189-4b3e-8928-b6a4690620d3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.081123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.081986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.082372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.082721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.084078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:19.084078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.085597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.101328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 276/560] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:19.101328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.101328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.155484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.189534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 285/561] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:19.190716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.222835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2342728-8c94-47f5-97d5-92736e7364a4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.262404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.263122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.263405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.263793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.264641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:19.264946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.266927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.286489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 277/562] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:19.287504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.318775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88e8ee-7b91-47f8-9a5a-1eed91fe74f1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.358275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.362955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.364024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.364525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.365475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.377192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.379032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:19.399231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:19.400377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:19.401286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:19.401286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:19.401286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.401286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:19.402194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04291e5-ad4d-4ea4-8e29-054c4c6e9c2b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.408699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 286/563] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:19.410203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.446268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.448109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.448391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.448711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.450550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.462126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.464700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:19.483218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:19.484390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:19.485395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:19.485395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:19.485395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.485395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:19.489852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 278/564] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:19.491179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.527546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180a70-ce5f-40eb-b7d8-15664b1e3809 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.564426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.565591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.569645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.569645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.578600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.580569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:19.601029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:19.603608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:19.604951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:19.604951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:19.604951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:19.604951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:19.607282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 287/565] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:19.608819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.611588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1cb30-06e4-4c32-b10e-e4e4d167fb12 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.632505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.653743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.655143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.655143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.655143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.655747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:19.656053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.657446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.673397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 279/566] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:19.673397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.707036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.722614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b82b05-6600-42de-863a-04003e48b1b2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.764829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.765604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.765889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.766172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.766896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:19.767210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.768575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a10423-fd0c-41b2-b0c2-48e1e73091cf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.788460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 288/567] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:19.788460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdeb3-74cb-4b75-8f31-83eed2b5375e None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.788460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdeb3-74cb-4b75-8f31-83eed2b5375e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.788460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bdeb3-74cb-4b75-8f31-83eed2b5375e None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.792298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 289/568] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:19.793087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdeb3-74cb-4b75-8f31-83eed2b5375e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.793519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538c298-90c3-404e-a9ef-f4033618a527 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.830245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.830906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.831209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.831487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.832215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:19.832514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.834216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.847665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 280/569] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:19.848856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:19.889325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:19.914887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bdeb3-74cb-4b75-8f31-83eed2b5375e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.953053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.953829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.954113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.954387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.958606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26eb730-4b09-45db-96be-0edc0a6bf063 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:19.962756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:19.964199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-2c544c98-769d-43c3-b31d-e07e6d069ac4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:19.978787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:19.980216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:19.981155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:19.984760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 290/570] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:19.985982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.986268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.986611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:19.998123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:19.999296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:19.999296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:19.999604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.000005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.005417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:20.008156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:20.008360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.008360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:20.023888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:20.025648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 281/571] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:20.026735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.081370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 291/572] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:20.082640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.135281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.141492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2c21b-cf56-4549-95c3-81cf46a4220c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.175971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.176755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.177034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.177333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.183006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b25ba-739a-4e90-a2ae-b224f7b44b40 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.184980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.186454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:20.199911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:20.200808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:20.201737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 282/573] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:20.202222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.220325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.221123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.221447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.221719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.222534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.222836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.224260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980e0cd0-edd0-4f9c-a5d6-ae7cb8d22dfc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.226734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.241903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 292/574] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.243160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730f6-8c26-4035-932b-b8fff200011a None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.243982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730f6-8c26-4035-932b-b8fff200011a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.244258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d730f6-8c26-4035-932b-b8fff200011a None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.247294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 293/575] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:20.247294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d730f6-8c26-4035-932b-b8fff200011a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.303921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c91b2d-c464-4e14-bd56-c74fb890fe39 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.337725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.338379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.338658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.338928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.339700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.340002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.341446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.349169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d730f6-8c26-4035-932b-b8fff200011a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.353951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 283/576] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.354764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.371455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.383588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.385088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.385405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.385682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.395471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:20.403433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:20.404567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 294/577] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:20.410488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.458763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.462621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f9d01-8d06-4334-b20a-08d1fa89592c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.497350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.497947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.498229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.498504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.499285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.499593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.501006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564f048-cd46-4c83-a16d-c50bc142a9e4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.504758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7921fec-c6d2-4439-aea1-39110a402c94 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.512370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 284/578] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.513603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.513890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.514164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.530666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:20.532926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:20.545009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.545839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.546124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.546402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.557842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.559304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:20.576026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:20.577090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 295/579] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:20.578102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.617768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 285/580] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:20.617768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.621827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.680442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89561d-4f5e-47d5-bf8d-f6e24b626844 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.687911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.715701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.716352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.716633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.716906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.716999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c35954-3de8-48d4-b9fe-90d2e56e2419 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.717844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=fcd9230db6ae4c46b4cfb0e07a103949) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.718351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.720175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.726008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 296/581] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/role_assignments?user.id=fcd9230db6ae4c46b4cfb0e07a103949&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.726561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.767319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.767932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.768217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.768492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.769396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.770192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.771234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.785740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 286/582] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.785740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.843013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d7945-eff8-4eb8-b218-15cb37bf2acf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.863157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:20.881451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.882341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.882617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.882884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.898971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=17726b67d4d54d38be845acf03cbb664, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.901053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.902411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d42e43-f6a0-4632-aba7-09912bccad49 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:20.938313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:20.938978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:20.939259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:20.939614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:20.940364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:20.940669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:20.942045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:20.953937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 287/583] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:20.954731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:20.977433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 297/584] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:20 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:20.979214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.016023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.093804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd2442-8035-4844-85c2-b7ec25b6784e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.126969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.132697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ee400-b7cb-43b1-a51b-0b6e8d1ea7cd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.138260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.139370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.139905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.140362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.154329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:21.163018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:21.163974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:21.164811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:21.168019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 288/585] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:21.169082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.177075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.178030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.178388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.178743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.193152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.195220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:21.216965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:21.217945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:21.218839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:21.218839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:21.218839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:21.218839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:21.218839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 298/586] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:21.219120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.289330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8593a-ed2f-4169-834f-31229a7ca2f6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.294387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.325094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3975b-f133-4480-8ddc-20ef5c120043 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.327446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.328306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.328588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.328917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.336455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.338030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:21.355557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:21.356464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:21.358007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 289/587] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:21.362354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.364500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.365172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.365498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.365774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.366516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:21.366820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.368202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.378071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 299/588] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:21.378897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.419213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.478108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c71992-1997-4844-b3ee-328309c2974a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.485996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d866c-f265-42d2-b928-3527eb66de78 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.516687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.517723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.518181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.518602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.522740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:21.522740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.523332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.527461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.528126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.528403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.528672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.529478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:21.529782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.534011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.535550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.545036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 290/589] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:21.546106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.562792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 300/590] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:21.562792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.694830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48df3b9-be0b-4ff7-ab38-55e66d62ed2b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.705276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.739474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.741097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.741747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.742240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.744518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7cf1ac-4ae7-4477-9c14-55f6837412b4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.755839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.758336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:21.784683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:21.785751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:21.786648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:21.786648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:21.786648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:21.786648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:21.789434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 291/591] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:21.791101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.797336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.798379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.798862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.799318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.809726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.812319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:21.833714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:21.834718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:21.835647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 301/592] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:21.836239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:21.921885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:21.927094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83b29d-7a60-461d-81ee-76e822c921af None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.968151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:21.968962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:21.969244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:21.969550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/6ce376ecc47a48c1bac3a5231d09c91c/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:21.973558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718950f-8eac-4774-b212-1f8179a533db None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:21.986342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=6ce376ecc47a48c1bac3a5231d09c91c, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:21.987837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.009595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.010265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.010548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.010827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.011543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:22.011845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.013197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.029358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 302/593] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:22.029358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.065548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 292/594] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:21 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/6ce376ecc47a48c1bac3a5231d09c91c/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:22.067291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.091976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.208793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e29ce-35e7-440b-b7ce-17e590cf1a94 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.246715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.288940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.291327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.292528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.294821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff5f5-6e1d-4ee7-9633-760cefdeb7a4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.295602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.296615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:22.297103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.298730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.327435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 303/595] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:22.333634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.340534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.341814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.342304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.342798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.352965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.355681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:22.376669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:22.378247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:22.379183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 293/596] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:22.383638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.463015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d52d-f152-4ba3-9f62-0b2d8a65e14b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.469628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.535035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a078494-79fc-4f00-8b02-968fda5ffb76 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.545212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.546052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.546349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.546622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.563467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.564974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:22.593507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:22.594459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:22.595337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:22.595337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:22.595337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:22.595337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:22.596756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 304/597] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:22.601656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.613588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.614275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.614559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.614833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.615684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:22.616101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.617585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.638870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 294/598] 10.222.0.71 () {56 vars in 1139 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:22.649323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.653608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.816186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ecfd6-84fd-4840-b671-798939afaf0b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.847061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aba4bb-3fd7-4ea0-8c38-1ec869a1a511 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:22.877655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:22.890128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.891114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.891404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.891682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.904719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.906236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.910071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:22.911172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:22.911667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:22.912143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:22.913127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:22.913686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:22.915428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:22.927568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:22.928553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:22.929919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:22.929919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:22.929919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:22.929919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:22.929919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 295/599] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:22.941281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:22.952669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 305/600] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:22.958172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.049760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e9dd0-7f96-40d5-afd6-7c6b3576fb8f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.091389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.092499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.092791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.093071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.097346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:23.097346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.097346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b08f8-472d-45fe-b9c6-e48cd1aefdaa None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.110994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 296/601] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:23.113511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e22d-aaf9-4be8-821f-be7d0822cd7b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.114030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e22d-aaf9-4be8-821f-be7d0822cd7b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.114535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818e22d-aaf9-4be8-821f-be7d0822cd7b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.116326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 297/602] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:23.119189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818e22d-aaf9-4be8-821f-be7d0822cd7b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.150684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.168491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94718eac-3aad-4bc1-be10-8cb64b3ce567 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.177355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.205754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.207040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.207548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.208095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.217365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.219305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b7ce50d4-3660-4050-9ec5-6f6ad97f6094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:23.237756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:23.238705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:23.239589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:23.246945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 306/603] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:23.248785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.249293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.249776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.255336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818e22d-aaf9-4be8-821f-be7d0822cd7b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.268414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:23.269989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:23.301506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.302316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.302601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.302892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.312552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.314035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:23.332664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:23.333974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:23.335078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:23.337374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 298/604] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:23.338491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.355237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 307/605] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:23.356189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.443583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.471732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4b07f8-9751-46a4-9114-8d132e6cec29 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.478945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.485394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d6f59-2fb3-476e-862f-0caca3f4ad68 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.509641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.510560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.510842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.511114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.511895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:23.512201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.513659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.537330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 308/606] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:23.537330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.537600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.537600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.537600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.537600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.537869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:23.537869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.537869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc57f58-9741-4594-9785-ab9b76c143dc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 299/607] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8d25-46f3-4c90-9bb2-e4ce8328661e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8d25-46f3-4c90-9bb2-e4ce8328661e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd8d25-46f3-4c90-9bb2-e4ce8328661e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 300/608] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:23.554950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8d25-46f3-4c90-9bb2-e4ce8328661e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.651519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f457c-ab52-424b-ae2f-582948079d20 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.674402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd8d25-46f3-4c90-9bb2-e4ce8328661e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.689291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.689900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.690188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.690486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.692411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.701672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:23.709806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:23.710797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:23.711639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 309/609] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:23.712883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.717024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.717989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.718274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.718548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/b4c5841ec0bd4e16b90e6b1c42ff0df1/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.735149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=b4c5841ec0bd4e16b90e6b1c42ff0df1, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.736599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f0da1b-6740-4cfe-a3cb-a8165eb6ab14 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.812091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e112eb-52a5-41df-bcc2-c0f4443c6cc7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:23.832907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 301/610] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:23 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/b4c5841ec0bd4e16b90e6b1c42ff0df1/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:23.834477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.838091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.838091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.854394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:23.855762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:23.857705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:23.858568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:23.859948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:23.860390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:23.860820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/5b23f15e3a064cd7b7cb6c100004a111/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:23.879817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=5b23f15e3a064cd7b7cb6c100004a111, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:23.882339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:23.934502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 302/611] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:23.935743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:23.972735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 310/612] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:23 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/5b23f15e3a064cd7b7cb6c100004a111/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:23.975502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.069491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.097208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903dbd0-28dd-4dfb-96ac-f3fe269bb983 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.136727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5d161-1253-4891-b054-67f0b4efe7a4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.137817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.138506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.138791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.139068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.139977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:24.140290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.141879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.148107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.153138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 303/613] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:24.159615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.188712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.189868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.190313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.190863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.217001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:24.230039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:24.231001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:24.231816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:24.234251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 311/614] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:24.239974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.297880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7863b-e0db-41ae-8020-a70c46ebb7f8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.375396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.377192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.378705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.379167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.406062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.407604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.418917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ceaef4-8577-4af9-9dac-b829369f515e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.422014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:24.447478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:24.448561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:24.449658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:24.449658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:24.449658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:24.449658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:24.449658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 304/615] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:24.455008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.460950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.465300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.465300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.465300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.465300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:24.465300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.465767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.485690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 312/616] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:24.488829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.556707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.635252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126472b6-c95e-4f55-b5e7-34e7bce0ae51 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.654562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02d22-0c21-40cc-a917-2acf4656daf3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.671882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.672793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.673225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.673718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.674586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:24.675041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.676555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7b13d-8850-48fc-ad8d-b9fa06ae417b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.690139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 305/617] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:24.691860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f897d0-12da-4b96-bb2c-2b18e458a634 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.692297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f897d0-12da-4b96-bb2c-2b18e458a634 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.692706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f897d0-12da-4b96-bb2c-2b18e458a634 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.694108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 306/618] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:24.699924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f897d0-12da-4b96-bb2c-2b18e458a634 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.705550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.706604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.707084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.707555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.720575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.722071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c40e2f2a-d34d-4ed7-8be4-5a729cc161e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:24.742446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:24.743970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:24.744890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:24.744890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:24.744890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:24.744890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:24.744890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 313/619] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:24.746035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.746325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.746606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.769290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:24.770792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:24.787633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.824194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f897d0-12da-4b96-bb2c-2b18e458a634 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:24.847264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:24.868794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 314/620] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:24.870316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.898374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:24.899936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:24.900227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:24.900791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:24.911163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:24.913310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:24.937803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:24.938790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:24.939784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 307/621] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:24.940924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:24.998712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59886377-2e89-46c8-8734-7e1c40971139 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.045793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.046475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.046768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.047325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.048054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:25.048622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.050686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.059009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae87609-0781-4a28-830c-a57b11369e79 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.066428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 315/622] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:25.067846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.080600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.111622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ae89-598e-45d2-9556-332210becbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.112429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ae89-598e-45d2-9556-332210becbad None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.113077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ae89-598e-45d2-9556-332210becbad None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.113389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172ae89-598e-45d2-9556-332210becbad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.127867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172ae89-598e-45d2-9556-332210becbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-e172ae89-598e-45d2-9556-332210becbad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:25.138228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:25.139578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:25.141225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:25.149281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 308/623] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:25.149281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ae89-598e-45d2-9556-332210becbad None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.178265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b11d-a151-4fc2-a416-2a5aae623547 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.187468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.217135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.217983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.218377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.218748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.219725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:25.220184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.221903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.240454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 316/624] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:25.241700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.283355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172ae89-598e-45d2-9556-332210becbad None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.312638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.333813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.335183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.335626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.336179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.346810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.349011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.350374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13167b-b65d-40c6-a94f-84c0457449ff None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:25.368524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:25.369758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:25.370927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:25.373072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 309/625] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:25.374167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.401856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.403473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.403939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.404605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.405827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:25.406302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.408548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.425121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 317/626] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:25.426332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.483067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.493365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5fc4b5-69e5-4558-b749-0d7a6fb9614c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.531313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.532238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.532623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.532998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.545428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.547099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.566126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbcd50-e322-4994-a6b5-b658fff536aa None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:25.570301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:25.573215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:25.574447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:25.574447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:25.574447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:25.574447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:25.575030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 310/627] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:25.576054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.597308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.606848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.607809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.608298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.608814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.609955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:25.610534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.612148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.638570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 318/628] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:25.638570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.700444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac6e82-141c-4cc0-9839-e8368adfa30c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.739241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.740537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.741023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.741589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.753947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.755783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.759347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.767139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ea5f0-87c4-49ce-8387-6ca4013df71d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:25.780748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:25.782181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:25.783071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:25.783071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:25.783071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:25.783071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:25.785339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 311/629] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:25.786444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.819097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.819678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.819966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.820642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:25.821523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:25.822044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:25.823838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:25.838050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 319/630] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:25.839258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:25.888505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:25.914333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c447-f550-43fd-9176-83498aed84a7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.953532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:25.954551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:25.954941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095ea437-b2b1-4f5f-8530-594fb39a9ce1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:25.955259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:25.955729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.001095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.001794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.002081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.002375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.003104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:26.003455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.005276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.019721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 320/631] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:26.020862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.037802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.047368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.049355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.159907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8836a64b-d0ef-4555-8bed-10d509dd6aaf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.170535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 312/632] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:26.171817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.172292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.199895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.201047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.201577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.202056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.211481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:26.226685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:26.228272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:26.229162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:26.232794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 321/633] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:26.234060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.295625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.303574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739d77a-cba7-40f2-8c18-51f886cb9e98 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.343866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.345054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.345775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.346119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.351493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f757d0-d6f7-4725-8110-819f505d27b4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.355453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.356907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:26.374933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:26.375921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 313/634] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:26.381853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.386463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.387285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.387572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.387845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.398951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.400936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-a6a7ab52-9680-46e6-bd1a-0e52f1136230 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:26.418938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:26.419831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:26.420732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:26.420732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:26.420732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:26.420732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:26.424879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 322/635] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:26.425854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807cd-4adc-4fba-8434-ede393120df4 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.426147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807cd-4adc-4fba-8434-ede393120df4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.426414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0807cd-4adc-4fba-8434-ede393120df4 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.427697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 323/636] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:26.428386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0807cd-4adc-4fba-8434-ede393120df4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.449925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.484215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9c32e-157c-44f0-a0e6-f4c599380b5a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.517738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.518401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.518686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.518968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.519761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:26.520069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.521603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.534772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 314/637] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:26.535598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.540961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0807cd-4adc-4fba-8434-ede393120df4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.558679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.577654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.578329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.578631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.578904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.579724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:26.580023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.581472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37545062-6a0b-4793-9abe-23b5cc4d9680 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.598717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 324/638] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:26.599932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a289-d23e-4f25-ba19-6c6361b62e4e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.600221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a289-d23e-4f25-ba19-6c6361b62e4e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.600495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309a289-d23e-4f25-ba19-6c6361b62e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.617542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e309a289-d23e-4f25-ba19-6c6361b62e4e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:26.619679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e309a289-d23e-4f25-ba19-6c6361b62e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:26.644653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71349-55ee-4527-88bb-a4749741d1bb None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.678467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.679353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.679635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.679910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.681307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:26.681676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.683055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.683980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 325/639] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:26.685552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aaa13-01e6-4b57-a431-218a84e3a20c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.685842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aaa13-01e6-4b57-a431-218a84e3a20c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.686119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aaa13-01e6-4b57-a431-218a84e3a20c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.691515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 326/640] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:26.691515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aaa13-01e6-4b57-a431-218a84e3a20c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.702326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 315/641] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:26.702326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:26.702563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.781292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.796212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aaa13-01e6-4b57-a431-218a84e3a20c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.803767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd2d4db-3439-4549-9dfb-abae8ec663cb None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:26.828919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.829836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.830115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.830385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/fcd9230db6ae4c46b4cfb0e07a103949/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.838250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:26.838885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.839164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.839442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.844930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=fcd9230db6ae4c46b4cfb0e07a103949, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.846542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a363ab-579c-4a14-9ebf-3febad84785d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.905725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:26.907179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:26.914241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 327/642] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:26 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/fcd9230db6ae4c46b4cfb0e07a103949/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:26.915544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:26.915831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:26.916106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:26.934356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:26.935494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:26.994788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:26.998657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.021292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 328/643] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:27.021292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.037400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 316/644] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:27.038317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.134133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81471ddc-5221-441b-8e15-8bb998c9e29e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.159826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff44f9-421f-45bf-96e5-760ee1e0bb1a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.171202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.172012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.172298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.172576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.179572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.182045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:27.195984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:27.197047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:27.198048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 329/645] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:27.199029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.199307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.200140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.200423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.200697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.213924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:27.221649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:27.222622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 317/646] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:27.223613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.255170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.263649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.315577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2b3fa-978c-4981-871d-60bd2059ae2b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.331848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f26709-df49-4016-a31f-818ba7c7d162 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.352056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.353474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.353845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.354129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.365780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.367276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.370860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.371987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.372471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.373000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.384072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:27.384756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:27.385662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:27.386571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:27.386571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:27.386571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:27.386571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:27.386571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 330/647] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:27.386854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:27.396965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:27.397960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 318/648] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:27.403810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.498180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.502447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f51-7397-43cd-a432-bf685ee22bf6 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.507536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.515047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b25bca-e87f-41a8-aca4-14ae1772e952 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.542241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.542907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.543192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.543466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.544245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:27.544556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.546078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.556451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.557238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.557560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.557837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.558579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:27.563787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.563913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 331/649] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:27.563913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.564069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.569684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 319/650] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:27.574309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.668320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec6ccc-18c7-4a65-b495-b726e13d1023 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.681521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665b4ef9-dc23-4e7e-a59b-1c29bce049e1 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.707209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.707883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.708416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.708844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.709511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:27.709768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.711137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.716785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.717483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.717768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.718042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.718790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:27.719095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.720456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.723976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 332/651] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:27.725060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.732788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 320/652] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:27.732788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.753957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.754876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:27.831939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa719cf-c30b-4bd1-8e2f-4720d829bf12 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.841185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d2d31-62fe-4b69-bcbb-4477a00fae7b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:27.869239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.870055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.870342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.870619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.877553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:27.878420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:27.878926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:27.879273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:27.880091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:27.880403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.881024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:27.881834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.882486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:27.895649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 333/653] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:27.895649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:27.910009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:27.910977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:27.911960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:27.911960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:27.911960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:27.911960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:27.911960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 321/654] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:27.917779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.001242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.013784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.042116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd920e4e-f914-4bf0-81bf-a55b8b72d84e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.043945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f8803-72fc-46f7-8bd7-b9c6579bd7f3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.087964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.088781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.089060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.089386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.090390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.091303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.091942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.092311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.101087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.101764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.103752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.104025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:28.120549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:28.121570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:28.122492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:28.125350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 334/655] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:28.126223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:28.127501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:28.128386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 322/656] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:28.130105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.265395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d76e4d-bc0a-4758-86b8-69bfec321953 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.266469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf7262-7122-4046-b4ba-71b9c4a8725a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.291783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.302638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.303369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.303702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.303980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.308264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:28.308264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.308446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.316278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.316944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.317227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.317973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.318983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:28.319297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.320661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.321704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 323/657] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:28.322556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.341760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 335/658] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:28.342732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.345323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.442163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75de828-f9d6-4c21-bc03-6afeff23a341 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.463437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae718a49-ee2c-49f7-9011-3b7024522dd1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.486475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.487539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.488289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.489003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.490039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:28.490497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.492578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.499509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.500164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.500443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.500713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.501641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=6ce376ecc47a48c1bac3a5231d09c91c) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:28.501951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.503567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.510470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 324/659] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:28.511886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.520009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 336/660] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/role_assignments?user.id=6ce376ecc47a48c1bac3a5231d09c91c&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:28.520009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.616294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.665234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.704844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc803d0-d74b-4ba1-9f26-8c6f4ec721c2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.742437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.743809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.744092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.744365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.752782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.754257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.762840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c869d1e-6164-46e0-9cef-40a9d91e916a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:28.770139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:28.771321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:28.772498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 337/661] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:28.777698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.816302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.817427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.817862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.818312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.827935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.829671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:28.846942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:28.848117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 03:18:28.849412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:28.857553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 325/662] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:28.859018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.895509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa46dab1-c723-4d18-81ab-f8098c6dd7cd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.929724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:28.941901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:28.942679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:28.943042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:28.943581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:28.944421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:28.944733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:28.947992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:28.975435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 338/663] 10.222.0.71 () {56 vars in 1137 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:28.981141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:28.988655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8384524-abf4-4cb3-9ee2-8dc98ece4241 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:28.991365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.028910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.031266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.031627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.031977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.032913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:29.033319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.034858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.055398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 326/664] 10.222.0.71 () {56 vars in 1139 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:29.060855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.098416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9fa6c-64a5-4b30-b6c7-4fac3f3e54e9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.141944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.142982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.143442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.143893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.206939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.225379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.227766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.301212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e29b5-7251-4d7b-8a9d-00ed64c7a224 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.337762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.338634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.338995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.339359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.342270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 339/665] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:29.348002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.372790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.413724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.415508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9c925-4cdd-4a72-8f7e-ccf1ea5f49e0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.441689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.459695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197042f-27a1-4e7c-a623-7096af8fd09f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.496859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.498291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.498782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.499275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.512031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.513906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.528315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 327/666] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:29.534312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:29.535183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:29.536073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:29.536073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:29.536073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:29.536073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:29.538241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 340/667] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:29.543209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eede9-1205-4961-a4bd-6c41295172d3 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.543209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eede9-1205-4961-a4bd-6c41295172d3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.543209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69eede9-1205-4961-a4bd-6c41295172d3 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.543209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 328/668] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:29.543209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eede9-1205-4961-a4bd-6c41295172d3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.544670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.611047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.652972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9a98-5db2-42bc-b31a-6c9566352af9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.655644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69eede9-1205-4961-a4bd-6c41295172d3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.692300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.693347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.693661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.694091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.694453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.694738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.695019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.695132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.696644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:29.697189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.699553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6160593-62d4-45c1-a26b-7c40dbc390f6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.702287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.709129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.713831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.720236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 341/669] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:29.721762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.722629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.722990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:29.732532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:29.733550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:29.734475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:29.734475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:29.734475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:29.734475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:29.740857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:29.741127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 329/670] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:29.741359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:29.742378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.842998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 342/671] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:29.843944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:29.859239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb086e1f-ad97-4596-bd27-39e632672089 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:29.875156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:29.903701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:29.904524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:29.904808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:29.905081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:29.914035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:29.915628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:29.933843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:29.934799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:29.935723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:29.936242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 330/672] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:29.936793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.071699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338418aa-4eb2-4ded-8bf4-b4bd8ad43dcd None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.098580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf9fb0-64e1-486c-a6c2-1be17760529c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.109580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.110439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.110727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.111007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.124434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:30.132460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:30.133786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:30.134656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 331/673] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:30.135348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.137316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.149423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.150636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.151084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.151773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.153144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.165521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.165521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.172521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.173062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 343/674] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.174069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.270606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6becaf-f89e-487f-a8f5-38bd52ac074c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.297187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca24b3-8e1b-4d58-af35-e35318640ca2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.316307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.317571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.318032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.318501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.319890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.320375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.322852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.335000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.335699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.335987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.336263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.338089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.338486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.344379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.345137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 332/675] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.346837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.353165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 344/676] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.354168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.408405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.458549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.464318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fed7a-0556-4714-a644-0007e7364222 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.465478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a51f0d-d670-4f34-a87e-754a71b63a6c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.498857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.499643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.499934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.500193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.504208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.505020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.505504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.505937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.507129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=5b23f15e3a064cd7b7cb6c100004a111) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.507288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.507728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.509848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.510167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.524486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 345/677] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/role_assignments?user.id=5b23f15e3a064cd7b7cb6c100004a111&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.524486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-8fbdfabf-a01a-4b56-8bbe-b3b463b8f33b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:30.524769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:30.525698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:30.526593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 333/678] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:30.530662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcf57-ea58-4d20-85a5-479a5ac74ade None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.530662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcf57-ea58-4d20-85a5-479a5ac74ade None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.530662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcf57-ea58-4d20-85a5-479a5ac74ade None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.534020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 334/679] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:30.534794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcf57-ea58-4d20-85a5-479a5ac74ade None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.661660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e015adb-1aac-4750-accc-9b31f382cc3e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.676648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.698039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcf57-ea58-4d20-85a5-479a5ac74ade None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.701705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.702507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.702788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.703063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.714743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.716273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-08027dc3-221d-44d2-8ce3-477d027c05bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:30.736591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:30.738166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:30.739260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:30.739260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:30.739260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:30.739260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:30.743320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 346/680] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:30.744130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.744251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.744506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.744786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.745364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.745854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.746569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.747500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.747960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.749581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.763975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:30.765125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 335/681] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.765289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:30.766231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.785214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:30.861345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 347/682] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:30.862528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:30.901703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea77b8-a101-47cb-bcfd-a2a077912b18 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:30.939703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:30.940685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:30.941252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:30.941743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:30.942652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:30.943140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:30.944691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:30.958416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 336/683] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:30.959549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.000093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.008053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b7264-93ba-47b2-ba86-8a3ad40b060f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.044454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.045619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.046115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.046567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.047572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=b4c5841ec0bd4e16b90e6b1c42ff0df1) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:31.048267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.050191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.054468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.058779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 348/684] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/role_assignments?user.id=b4c5841ec0bd4e16b90e6b1c42ff0df1&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:31.059841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.106075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fb0ae-373c-43e3-836b-289d33611e6f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.150679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.151487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.151770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.152042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.165005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:31.173744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:31.174763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:31.175654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:31.180436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 337/685] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:31.181951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.307708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd6b9c-560f-431e-b67f-f7f5499a3bd0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.319574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d1db6-5217-4817-952f-ce8a728c565c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.360981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.362845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.364538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.364971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.366110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:31.366421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.368357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.370518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.378511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.379363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 338/686] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:31.388686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.388686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.388686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] PATH_INFO: `/v3/users/swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.388936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.396822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.398398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:31.416921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:31.417986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:31.418971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 349/687] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:31.426057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.452827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.515674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb6f42-d603-4f1e-bd24-701f4a812f06 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.557200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb11a3d-cef0-4e9d-8adc-6689f72f6ade None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.559820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.560556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.560832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.561098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.577557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.580071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.597724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.604101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd969df-bd07-4d07-a9a6-dd7314228c4b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a8dc9415-8553-4957-87a9-68499ecf1f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:31.606727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:31.607587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:31.608495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:31.608495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:31.608495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:31.608495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:31.608495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 339/688] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:31.609288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fcde2-8901-46b1-b08f-d8b184f00fed None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.612060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fcde2-8901-46b1-b08f-d8b184f00fed None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.612750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fcde2-8901-46b1-b08f-d8b184f00fed None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.614935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 340/689] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:31.620514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fcde2-8901-46b1-b08f-d8b184f00fed None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.629986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 350/690] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:31.635186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.635478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.635946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.655340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:31.656522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:31.683788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.739458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fcde2-8901-46b1-b08f-d8b184f00fed None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.759994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 351/691] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:31.759994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.776800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.802973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.803648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.803931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.804326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.805073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:31.805403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.806775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:31.825450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 341/692] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:31.826615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:31.911832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86373b20-e49d-4994-9d77-39fd648e2aa3 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.938719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bd996-7271-45e5-a396-03a34d224998 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:31.949179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:31.951193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.952065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.952542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.953031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.980793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:31.981747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:31.982506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:31.983213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:31.995814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:31.997418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:32.015776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:32.016892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:32.017991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:32.017991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:32.017991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:32.017991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:32.019279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 342/693] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:32.020139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.033351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.035141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.049618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.126883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31363179-a012-4a2c-add8-0fc1f9f9cd16 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.143395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 352/694] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:32.144852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.163138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.164034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.164409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.165376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.173705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.175028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:32.189279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:32.190251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:32.191224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:32.195240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 343/695] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:32.196275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.219614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.255479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb46f1-4c15-4f57-bbfc-914cd0d4d46a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.292981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.294132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.294602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.295053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.296035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:32.296611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.301423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.302403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558e5a4-e658-4640-a08a-ed995f00cc10 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.302616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.319330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 353/696] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:32.320651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.341551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.342549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.342935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.343314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.356574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.358440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:32.376388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:32.377392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:32.378563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:32.378563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:32.378563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:32.378563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:32.378563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 344/697] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:32.379727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.458912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.467999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29788aec-7e3e-4627-9798-ccd950dd11dd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.490065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392964b-6007-4c36-8c41-655d05c9d312 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.512128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.512976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.513407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.513784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.514727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:32.515144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.516699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.536236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.537126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.537639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.538056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.538927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.540827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.549823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 354/698] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:32.550864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.578942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.631740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 345/699] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:18:32 2022] POST /identity/v3/users => generated 254 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:32.634358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.698830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9db292-3d47-4f60-9638-02c472cea2fa None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.772343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.774057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.774533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.775041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.776003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:32.776466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.778069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:32.792049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 355/700] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:32.802192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:32.849214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0958c4-ac16-4109-8702-6e467f9f23d3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.881363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.897201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:32.897201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:32.897201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:32.897201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:32.938548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:32.962536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7c09f-ad40-440a-9d61-0b2e4c67eb3a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:32.995261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:32.997389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.006880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.007680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.007961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.008687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.017019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.018755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5de78a50-f0b2-4d83-800d-bed4f8fa4fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:33.037370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:33.038320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:33.039226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:33.040195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 356/701] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:33.041355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feca30-584d-4485-9f70-fa2eb4bbfafe None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.041642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feca30-584d-4485-9f70-fa2eb4bbfafe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.041919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feca30-584d-4485-9f70-fa2eb4bbfafe None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.047346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 357/702] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:33.049560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.049847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.050484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.072519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:33.073731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:33.112429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 346/703] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 03:18:33.113412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.148103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.161847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 358/704] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:33.163009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.234963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39a65d-c823-49b4-9133-72ebc96d186c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.264940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.272481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.273202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.274678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.286563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.286563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:33.286563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.286563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.297306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 347/705] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:33.297306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.300764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155be504-5687-4f07-af46-441cc652d6e7 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.338487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.339391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.339677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.339952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.351069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.353705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:33.372979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:33.373993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:33.374893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:33.374893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:33.374893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:33.374893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:33.374893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 359/706] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:33.375622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.421934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.440250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ae610-e4dc-4da9-a02c-1600a3aadb0e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.496305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c405d-9f9f-4b0b-be7b-6f71bdea0afd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.498424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.500410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.500856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.501304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.502145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.503671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:33.523471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:33.525706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:33.526617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:33.527449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.530624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 348/707] 10.222.0.71 () {56 vars in 1129 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:33.531634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.538629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.540234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.540522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.543064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.544407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=fcd9230db6ae4c46b4cfb0e07a103949) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:33.544407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.546216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.557879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 360/708] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/role_assignments?user.id=fcd9230db6ae4c46b4cfb0e07a103949&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:33.557879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.703237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dacfacb-70f2-476b-8577-036336eb377d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.734734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c116c6-6a15-432d-8dfd-09011b7cfa07 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.752411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.753572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.753952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.754322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.755766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:33.756188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.757745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a0de2-a5f6-4812-8bd1-ea841f9d3c18 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.775732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 349/709] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:33.777240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6139f5-1e5a-4001-9427-4fba50776cd2 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.777653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6139f5-1e5a-4001-9427-4fba50776cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.778024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6139f5-1e5a-4001-9427-4fba50776cd2 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.779648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 350/710] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:33.781837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.782525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.785279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.785279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.785279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:33.785279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.785623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80efecd0-9fed-4e8f-8375-01e3e45a372a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.786244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6139f5-1e5a-4001-9427-4fba50776cd2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.790762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 361/711] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:33.792039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.792321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.792597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.807696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.810762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:33.811952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:33.872674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:33.892252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 362/712] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:33.893179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:33.915153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6139f5-1e5a-4001-9427-4fba50776cd2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:33.957080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:33.957877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:33.958406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:33.958679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:33.967378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:33.968835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:33.984332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:33.985296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:33.986285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 351/713] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:33.986770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:34.033968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f11fc7-8e4a-4496-95a4-6e7cd8ee3c97 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.080476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.081510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.081800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.082078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.083062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:34.083625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.085162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.092958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 363/714] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:34.097294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:34.127983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:34.173442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de430ed-5020-4672-8f7f-5b568844c14e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.207838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:34.259361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.260991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.262474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.263743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.264633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.266731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.269853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423479c4-046f-40d1-8f0f-002623ba2ebf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:34.289517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:34.290572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:34.291395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:34.298774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 352/715] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:33 2022] GET /identity/v3/services/network => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:34.304131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:34.337810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.338410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.339006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.339487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.340700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:34.341012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.342788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.357509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 364/716] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:34.364010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:34.425214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9855ef-8f48-40d9-af8a-c06cf38984d2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.461977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.462994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.463485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.464022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.464924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:34.465472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.467039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.469335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:34.470123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa1f40-c467-4905-8dc3-7dd831f15786 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.473769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 353/717] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:34.481656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:34.484965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:34.530051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.530718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.531000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.531276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.532537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:34.532850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.534296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fe29d-4551-43a4-8fb3-1dbeb4de6cdc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.544125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 365/718] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:34 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:34.632216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5515908-7244-4775-abd1-0cfe5b3b63e8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:34.713830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:34.714462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:34.714698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:34.714967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:34.715751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] RBAC: Adding query filter params (type=network) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:34.716054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:34.717510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29438aea-e0dc-432c-8f4e-75baa8967547 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:34.729829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 354/719] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:35.488641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec4b5-c15a-4c65-8967-dca59c47a87d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:35.489155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec4b5-c15a-4c65-8967-dca59c47a87d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:35.489232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ec4b5-c15a-4c65-8967-dca59c47a87d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:35.490651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 366/720] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:35.496400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:35.496691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:35.496971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:35.517975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:35.519158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:35.603442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:35.615852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 355/721] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:35.650625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ec4b5-c15a-4c65-8967-dca59c47a87d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:35.772776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ec4b5-c15a-4c65-8967-dca59c47a87d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:35.809636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:35.810827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:35.811337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:35.811809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:35.823171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:35.831461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:35.832414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:35.833545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:35.836842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 367/722] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:35.846368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:35.959410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab384e0-9250-4209-a1c0-2f6e6d27e4f6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:36.000675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:36.001373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.001656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.001929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.002704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:36.002976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:36.004357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:36.014710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 356/723] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:36.020323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:36.112929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:36.225170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc82b5-34f8-460b-89db-102e20ec1804 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:36.260160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:36.260987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.261297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.261578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.271951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:36.273488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4bad0a5e-cc95-4b7c-8d6c-01ff7507a78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:36.296282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:36.297244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:36.298242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:36.298242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:36.298242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:36.298242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:36.298242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 368/724] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:36.306382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:36.376270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b810-fe25-4b21-9326-16b96a878727 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.376609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b810-fe25-4b21-9326-16b96a878727 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.376835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3b810-fe25-4b21-9326-16b96a878727 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.378495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 369/725] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:36.395457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.395746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.396011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.399804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:36.433580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:36.434790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:36.451827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58248e57-1509-48ff-b2ab-fa9d6bfe1dde None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:36.497386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:36.498075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.498358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.498630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.499362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:36.499670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:36.501046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:36.534183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 357/726] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:36.541299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:36.589398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 370/727] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 03:18:36.615307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:36.638257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:36.727821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5014b2c7-400b-4a6f-9f08-ce078259b8b8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:36.777109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6cac1d-e3b2-4f04-a0e7-90ff0b156498 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:36.785614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:36.813226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:36.814439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.814733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.815003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.826899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:36.838941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:36.839915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:36.840763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 371/728] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:36.847799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:36.861145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:36.862648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:36.863139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:36.863617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:36.874092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:36.877157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:36.905806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:36.906793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:36.907750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:36.919208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 358/729] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:36.925630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.011726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.041935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa65944-74ca-43ca-9d20-ea48a29a1a65 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.082188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.083543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.083843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.084122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.084987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:37.085329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.087187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.091665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c9b4ea-3637-475c-8b35-aa36dea61043 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.113653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 359/730] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:37.115318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.143630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.144345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.144630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.144965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.145885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:37.146195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.147564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8345f-c22e-4d9d-bba0-8d01f0e17162 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.156925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 372/731] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:37.158183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25246-cfc3-4564-96dd-f33fb6bd0187 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.158472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25246-cfc3-4564-96dd-f33fb6bd0187 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.158751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df25246-cfc3-4564-96dd-f33fb6bd0187 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.159276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.163026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 373/732] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:37.166404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df25246-cfc3-4564-96dd-f33fb6bd0187 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.239088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210827c-cd06-4356-8db8-5e03e3b9b3c2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.276111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.277192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.277806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.278350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.299978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df25246-cfc3-4564-96dd-f33fb6bd0187 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.341150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.341999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.342286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.342565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.346396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.355917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.357402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.362978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.364575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae33d58-0ccd-4e87-8d7e-e0d8ad6603e4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-27e1c0c2-78fa-43de-ace8-08d5a78ed819 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:37.374640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:37.375716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:37.376839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:37.376839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:37.376839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:37.376839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:37.376839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 374/733] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:37.377471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351126-3b54-4ec5-a6ac-49b3e09d94ed None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.377760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351126-3b54-4ec5-a6ac-49b3e09d94ed None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.378043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39351126-3b54-4ec5-a6ac-49b3e09d94ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.395981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-39351126-3b54-4ec5-a6ac-49b3e09d94ed None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:37.397173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-39351126-3b54-4ec5-a6ac-49b3e09d94ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:37.407473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.470535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 375/734] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:37.472088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d7c0-d0b1-4f25-9b98-2039c3183b4c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.472380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d7c0-d0b1-4f25-9b98-2039c3183b4c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.472657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9d7c0-d0b1-4f25-9b98-2039c3183b4c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.474229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 376/735] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:37.479313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9d7c0-d0b1-4f25-9b98-2039c3183b4c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.499738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 360/736] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 03:18:37.501427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.501721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.501996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.518218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:37.519411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:37.584020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9d7c0-d0b1-4f25-9b98-2039c3183b4c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.587462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 361/737] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:37.588273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.601630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.619510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.620172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.620456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.620751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.621475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:37.621782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.623139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37f390-bdf6-45a9-b3bc-a5d9c39718f7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.634864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 377/738] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:37.636002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca363630-4c9f-451d-b105-94c6e04810f4 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.636415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca363630-4c9f-451d-b105-94c6e04810f4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.636889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca363630-4c9f-451d-b105-94c6e04810f4 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.641294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 378/739] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:37.641294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca363630-4c9f-451d-b105-94c6e04810f4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.656093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.693950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac3bb57-d466-44e7-bde5-4f6279e289b8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.727728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.728394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.728682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.728955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.729696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.731064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.741424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca363630-4c9f-451d-b105-94c6e04810f4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.774478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.775283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.775547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.775820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.785710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:37.787185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:37.804647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:37.806617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 379/740] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:37.807537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.836495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:37.845698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 362/741] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:18:37 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:37.846589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:37.917519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcff2cb-1bcb-4906-9217-6ab2e518cf6e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.969819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:37.970548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.970834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.971109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:37.984276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:37.987722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2cf40-f184-4f3d-9a06-e08da88072db None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-bb47c446-e706-4137-9399-60de1503d000 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:37.992276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:37.993302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:37.994208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 380/742] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:37.995388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:37.995679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:37.995959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.013940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:38.015186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:38.021499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.035121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.035121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.035121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.035460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.045179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.046666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:38.062224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:38.068351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 363/743] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:38.069380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.101030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 381/744] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 03:18:38.106018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.126414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.176436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0e094-241c-4d9a-a292-badae3ed9bc3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.211859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.212518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.212623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae62a3-752d-4c0c-abd4-d301791074e5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.212804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.213076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.213832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:38.214140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.215526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.227454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 364/745] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:38.228175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.255874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.256566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.256856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.257135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.258677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:38.259037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.260419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.275884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 382/746] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:38.275884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.290694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.350469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35715906-6591-459d-b98b-9b84515c2201 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.357932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.383835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b25c23-0ff8-4c4c-a8c6-8b1bfa0ebb4e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.389315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.389992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.390276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.390553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.391391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:38.391697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.393134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.411265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 365/747] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:38.412306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.424717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.425421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.425715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.425977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.426694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.428053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.520068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 383/748] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:18:38 2022] POST /identity/v3/services => generated 240 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:38.520254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0ef03-dece-4fcc-894b-b4fb0080cb53 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.520351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.520438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.572516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.574045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.574529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.575141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.583827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.586655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:38.603453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:38.604449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:38.605363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:38.608013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 366/749] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:38.609214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.636977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca4ce4-d8d2-4b49-9380-a231a76a0fa9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.675275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.676097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.676386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.676718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.685335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.690119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.691730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:38.710510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:38.712052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:38.712989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:38.712989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:38.712989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:38.712989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:38.712989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 384/750] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:38.713744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.741713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca374bcd-8cb5-424b-a063-bff7180886c8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.789100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.789771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.790062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.790343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.823184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:38.839092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dcb8d6-4c6e-456a-86c1-780be934fcb2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:38.871583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.873512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.891262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:38.892539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:38.893372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:38.893900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:38.894889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:38.895419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:38.897906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:38.915651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 385/751] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:38.921051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.984262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 367/752] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:18:38.985155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:38.988287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.045939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397be37a-a1fd-42d7-b713-4c2159580598 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.048724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.082799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.083873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.084262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.084701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.085492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:39.086857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.087966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.096111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a11f3-eb71-4cba-afd3-0b8049070a04 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.105411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 386/753] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:39.106484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.134344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.135346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.135863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.136362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.137475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=e9a0738758e145e28f087b36ded06e48) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:39.138004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.139698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.146466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 368/754] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:38 2022] GET /identity/v3/role_assignments?user.id=e9a0738758e145e28f087b36ded06e48&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:39.147568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.300860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546674-dbaf-4bdf-9030-63a81ee9c9a5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.329556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.353911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b6152-33c7-4f76-a0b9-42773ec16a28 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.377905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.378532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.380221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.380711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.381206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.391199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.391998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.392279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.392552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.395142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.396887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.401426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.402974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:39.417655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:39.418595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:39.419477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:39.419477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:39.419477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:39.419477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:39.419709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:39.420529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:39.421630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 369/755] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:39.424715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 387/756] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:39.429028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.430461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.546238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c351416-e190-4513-a851-11c0b1d9e4b8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.608185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bff732-9db8-42a7-8e93-67f730d0559f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.613894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.614750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.619971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.620437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.621464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:39.625619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.625619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.655109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 370/757] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:39.660482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.678315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.678980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.679265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.679540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.680809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:39.681321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.686199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.710432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 388/758] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:39.716139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.760601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.761504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:39.824160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96dca3-ec3e-4f0f-86ff-cc8a9504ed69 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.861833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.862549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.862829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.863101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.864250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14cedfc-0b6f-44b4-b751-669f4fdb5a13 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:39.874630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.875976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:39.895454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:39.896426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:39.897384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:39.897384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:39.897384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:39.897384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:39.897384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 371/759] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:39.902799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:39.906760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:39.907903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:39.908390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:39.908899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:39.917159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:39.918947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:39.934789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:39.935717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:39.936600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:39.939159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 389/760] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:39.947057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.003581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:40.012617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59454f-4879-4ba7-ad56-2752723ae32f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.038366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:40.048300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.049034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.049611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.049611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.050238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:40.050548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.051904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.062207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d2eb-d722-4f28-bbaa-8e04a20f4f0d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.065299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 372/761] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:40.070343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.100764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.102375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.102875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.103507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.104588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:40.105098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.106735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.120838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 390/762] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:40.127133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.179440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9eb19-e1e8-415d-a857-99ceaa54456a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.216832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.217736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.218018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.218298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.225472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.227015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.244321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53e654-541e-4e6b-8ca8-961f85889978 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:40.249933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:40.250840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:40.251744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 373/763] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:40.257189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.285673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:40.301662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.302678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.303179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.303671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.304733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=fcd9230db6ae4c46b4cfb0e07a103949) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:40.305250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.311982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.319401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 391/764] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:40 2022] GET /identity/v3/role_assignments?user.id=fcd9230db6ae4c46b4cfb0e07a103949&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:40.380429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068126c6-0d80-475c-9d4f-b3969736d729 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.420458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.421135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.421446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.421780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.422582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:40.422925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.424384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d51931c-5889-47d1-ba6f-e48680606447 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.438625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 374/765] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:40.444522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.455955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:40.518167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236acc7-f79a-41b5-a109-461acdf366cc None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.518508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236acc7-f79a-41b5-a109-461acdf366cc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.518726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236acc7-f79a-41b5-a109-461acdf366cc None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.520119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 375/766] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:40.538057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.538354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.538623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.561774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:40.562969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:40.587905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff193b4-8433-439e-8284-9b28f11da77a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.640897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.641790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.642073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.642350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.644941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=17726b67d4d54d38be845acf03cbb664, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.646422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.660339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 376/767] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:40.683579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.685781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:40.719705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 392/768] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:40 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:40.815956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd27f8-45a7-42ac-af4e-714c7042b14a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:40.857090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:40.857963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:40.858248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:40.858523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:40.859189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:40.860595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:40.874360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:40.875405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:40.876241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 377/769] 10.222.0.71 () {56 vars in 1129 bytes} [Fri May 27 03:18:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:40.881919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:40.962126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:41.002703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657186e-be59-41d2-b0a9-a65d136dbe7b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.039336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.040450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.040958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.041465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.042370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:41.042906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.044471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8c905-ea29-45a4-834a-d9bb646df634 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.049916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 393/770] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:41.055828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.148819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:41.179100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef472-1f47-4401-bb98-fea8334d2b64 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.180697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef472-1f47-4401-bb98-fea8334d2b64 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.181411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ef472-1f47-4401-bb98-fea8334d2b64 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.183012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 394/771] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:41.191047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04bf-6387-4f95-88cd-ce5c499e60bf None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.197301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.197599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.197875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.222662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:41.223802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:41.267137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.268178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.268634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.269093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.270560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:41.271094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.274240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.297490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 378/772] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:41.303295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.318712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 395/773] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:41.369121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.479539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39d3570-4d42-4b81-aec1-f187538d62ec None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.485335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:41.541439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc826d9-188b-4729-a1ef-dfa9952158aa None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.559463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:41.582540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.583475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.583765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.583871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.584067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.584735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.584842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] RBAC: Adding query filter params (interface=public, service_id=c842fc19a6bf4834bdfc04ef4e904739, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:41.585024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.585187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.585383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.586104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.587033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.587464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:41.602547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:41.603598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:41.604799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 396/774] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:41.611847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.612870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 379/775] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/endpoints?service_id=c842fc19a6bf4834bdfc04ef4e904739&interface=public®ion_id=RegionOne => generated 194 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:41.623367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.772760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbbfd5-98ff-4e09-be90-d6940bbd28f3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.801667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:41.814322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.814797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.815084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.815360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.819995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] RBAC: Adding query filter params (name=network) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:41.819995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.820262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3281c0-e634-4d30-9268-d8b0eb34d9ba None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:41.820351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.823650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 397/776] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:41.829653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:41.884075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:41.884751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:41.885038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:41.885334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:41.886024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:41.887766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:41.899723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 380/777] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/services => generated 772 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:41.975310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b075a-23e6-4c8e-af46-84d158100d61 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:42.016634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:42.017432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.017723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.018001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.018796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:42.019113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:42.020777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:42.027744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 398/778] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:42.034256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:42.124043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:42.187092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015de8-6d3b-4c1a-88ad-e1e7e928ddfc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:42.223585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:42.224609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.225110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.225619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.227128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] RBAC: Adding query filter params (interface=public, service_id=c9184f2a2f45414192fd20a518308e89, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:42.227772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:42.229370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac179594-78b1-43de-95d3-89238a0a652f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:42.239492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 381/779] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:18:42 2022] GET /identity/v3/endpoints?service_id=c9184f2a2f45414192fd20a518308e89&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:42.242833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:42.308618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a904e-a4ba-4bdf-9b27-a600490db154 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.309235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a904e-a4ba-4bdf-9b27-a600490db154 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.309741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a904e-a4ba-4bdf-9b27-a600490db154 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.310437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:42.312843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 382/780] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:42.317283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.317794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.318295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.346318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:42.349118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:42.368517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd100d1c-573c-45b6-bcb0-03d080eea4b5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:42.405952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:42.407097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.407312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.407589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.408269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:42.409836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:42.417032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 399/781] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:18:42 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:42.483700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 383/782] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:42.524774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:42.662562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd507-3349-4d0b-afb3-37f85bdf3f04 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:42.682010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:42.701536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:42.702344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.702629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.702904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.714967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:42.723014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:42.723931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:42.724940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 400/783] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:42.731578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:42.791821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:42.848081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f07b1-dede-4772-8a5e-116594fb556f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:42.892355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:42.893038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:42.893359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:42.893628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:42.894419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:42.894694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:42.896065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04eb92-9c55-4ba8-9c48-08ef05e71d0d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:42.905570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 384/784] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:42.911228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.046088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6da360-ccb6-432b-a178-51a0accfccdc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.099826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.100631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.100909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.101709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.119211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.120654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.125434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8589c6-10c6-45c1-b30d-89ea55f6bef5 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.126312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8589c6-10c6-45c1-b30d-89ea55f6bef5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.126796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8589c6-10c6-45c1-b30d-89ea55f6bef5 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.133364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 385/785] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:43.139009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.139394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.139569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:43.145805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:43.146712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:43.147613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:43.147613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:43.147613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:43.147613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:43.150647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 401/786] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:43.156236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.165566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:43.166759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:43.217640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.284809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 386/787] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:43.311440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.370020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8237f-4ca1-4562-b2ea-b9903f5d84a2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.395171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.443403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.444505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.444990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.446336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.447274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:43.447828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.449430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.456831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d0454-5dc6-49c8-ab0c-aa5cbc04a2a4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.476910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 402/788] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:43.482008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.500832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.501707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.502217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.502681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.517902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-74d25909-5a1c-4274-8c59-f3e24706b266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:43.528124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:43.529040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:43.529919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:43.534223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 387/789] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:43.535565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ae45-364b-41e7-8154-f06c2d486790 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.535856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ae45-364b-41e7-8154-f06c2d486790 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.536137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88ae45-364b-41e7-8154-f06c2d486790 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.538014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 388/790] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:43.539530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88ae45-364b-41e7-8154-f06c2d486790 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.597449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.614058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66760-c316-4e9c-8665-6ac5c2a52730 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.657950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.659677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.660165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.660865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.669607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88ae45-364b-41e7-8154-f06c2d486790 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.671055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.673574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.673696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-948b0484-68c6-4dfc-b8c0-b8df59bcdd16 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:43.696555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:43.697622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:43.698602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:43.700066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 403/791] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:43.700268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.700479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.700761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.714807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.715863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.716358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.716834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.717879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:43.718405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.719665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:43.720353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.720854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:43.735386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 389/792] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:43.736721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.792896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 404/793] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:43.793826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.850199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aed864-90c2-4232-81ad-61dd738458d9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.878517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.890815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.891828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.892407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.892890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.893985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:43.894457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.899021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.900349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb0bc3-3fb6-496f-b67e-7fae6ffbc318 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:43.916508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 390/794] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:43.917858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:43.937366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:43.938170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:43.938452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:43.938731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:43.948909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:43.950201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:43.951669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:43.971500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:43.972449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:43.974108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:43.974108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:43.974108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:43.974108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:43.977557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 405/795] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:43.978502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.038187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601ef8-e66f-46f0-af64-4a8e19f273d3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.080851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.081696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.082107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.082401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.091989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec351b06-6e23-4e12-a972-f70080385516 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.096273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:44.105733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:44.106693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 391/796] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:44.108128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.131626 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.140291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.141779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.142261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.149101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.155958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.157544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:44.177014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:44.178090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:44.179296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:44.179296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:44.179296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:44.179296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:44.179296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 406/797] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:44.180396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.215781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.233956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46bd35-290b-4489-ba50-8b844008606f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.273544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.274747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.275266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.275723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.276833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:44.277653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.279871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.287236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6ac7d-ab1c-467e-84b2-4aaff0ea4237 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.299696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 392/798] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:44.301012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.324636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.325469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.325836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.326183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.327009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:44.327615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.328797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.338717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 407/799] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:44.339540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.389348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.418067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48a694-c647-4da7-bda4-3dd4e5e01dea None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.448938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674691e-ac87-41c6-a706-229dd31c0801 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.456851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.457825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.458566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.459132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.460036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:44.461178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.462752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.487297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 393/800] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:44.487297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.491021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.491916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.492052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.492436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.492905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.501788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.503337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:44.519184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:44.520418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:44.521597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:44.524048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 408/801] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:44.533979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.624468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6dab-4a72-4b23-affe-46b18856db88 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.642574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d0d52-173d-487f-aea6-fa7beb3d9665 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.645021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.659987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.660784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.661065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.661466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.672545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.674056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.685065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.686206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.686692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.687167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:44.693436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:44.694310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:44.695851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:44.695851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:44.695851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:44.695851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:44.695851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 394/802] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:44.696769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.698061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.699851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:44.716538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:44.717533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:44.718462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:44.721066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 409/803] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:44.722066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.763340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.812865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95315777-e827-4be8-84c7-6174c37e832a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.837931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba791d1f-f7f3-4ece-8ddd-90a61ed28bc3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:44.851634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.852317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.852605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.852877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.853822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:44.854133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.855574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.873489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 395/804] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:44.875712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:44.876384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.876669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.876946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.877702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:44.878014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:44.878699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.879416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6742cea-dfb7-41dd-b8b4-1f2607e68e27 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:44.892674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 410/805] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:44.893966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3be8-f77f-4e17-9bc9-aef2ae65ce97 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:44.894219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3be8-f77f-4e17-9bc9-aef2ae65ce97 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:44.894498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc3be8-f77f-4e17-9bc9-aef2ae65ce97 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:44.900218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 411/806] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:44.901021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3be8-f77f-4e17-9bc9-aef2ae65ce97 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:44.928171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:44.997169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b1aa3-d47a-45da-82c2-d957b72479c6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.011431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc3be8-f77f-4e17-9bc9-aef2ae65ce97 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.011942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.031156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.031811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.032094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.032374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.033157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:45.033504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.034935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.046327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 396/807] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:45.047115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.051929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.052728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.053016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.053390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.064482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.065963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f0d2c279-3f95-4cbd-9e3f-565022072dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:45.084381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:45.085437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:45.086333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:45.086333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:45.086333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:45.086333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:45.086333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 412/808] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:45.087117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eba27-1a9e-4e58-ad01-ccc4cd2c8e24 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.087406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eba27-1a9e-4e58-ad01-ccc4cd2c8e24 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.087683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6eba27-1a9e-4e58-ad01-ccc4cd2c8e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.104007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cc6eba27-1a9e-4e58-ad01-ccc4cd2c8e24 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:45.105194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cc6eba27-1a9e-4e58-ad01-ccc4cd2c8e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:45.155646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ed2b0-af00-4a2a-a148-de6311947179 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.171620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 413/809] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:45.172929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d943-0c90-4005-921b-94dc64fcad91 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.173220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d943-0c90-4005-921b-94dc64fcad91 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.173600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d943-0c90-4005-921b-94dc64fcad91 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.174853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 414/810] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:45.175527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d943-0c90-4005-921b-94dc64fcad91 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.194509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.196049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.196848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.197128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.197437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.205922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.207410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:45.222149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:45.223700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:45.224898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 397/811] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:45.225921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.261595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.293586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d943-0c90-4005-921b-94dc64fcad91 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.326666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e5143-b260-4c09-bf18-ed03594124cd None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.329541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.330437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.330721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.331000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/e9a0738758e145e28f087b36ded06e48/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.346016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=e9a0738758e145e28f087b36ded06e48, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.347463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.359886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.360536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.360817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.361090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.365858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:45.365858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.365858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf641dd-b84f-45b7-81d5-5fd81caf2fcc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.374887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 398/812] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:45.376044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.376329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.376602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.392406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:45.393610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:45.428271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 415/813] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:45 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/e9a0738758e145e28f087b36ded06e48/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:45.429132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.465526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 399/814] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:45.466267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.503381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.515336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.573890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcddfdd-62c6-4fb6-8a8d-73f6e2c0379c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.597495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a938f-4b6c-4ca2-ae92-8daac7549358 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.611992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.613349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.613349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.613548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.614753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.616493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:45.633956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:45.634962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:45.636210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 416/815] 10.222.0.71 () {56 vars in 1129 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:45.637332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.641595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.642285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.642577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.642839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.643683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:45.643991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.645585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.673051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 400/816] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:45.674262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.751363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4d3c8-91ce-4b84-99ed-df2af5fa80e7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.763910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.775843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:45.789661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e932fa-beeb-4004-8280-2bbd2fdd8483 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.791934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.792752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.793030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.793343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.800194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.801662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:45.816453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:45.817574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 417/817] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:45.818508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.825491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.829621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.829621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.829621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] PATH_INFO: `/v3/services/network` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.829621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.829621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:45.843813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:45.844817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:45.845808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 401/818] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:45.847201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.935856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140cbd8-d1cb-4b5c-9c42-e7b79e48d39e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.955156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169d2f2-2f60-4bc8-bf57-2a5e6c1fa28a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:45.973418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.974092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.974379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.974655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:45.975591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:45.975702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:45.977910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:45.982759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 418/819] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:45.983548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:45.996206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:45.996885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:45.997173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:45.997496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.014374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.033580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.075038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.076554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.090149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c58211-6aa5-4f61-9ba1-179da0118a60 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.127272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.127935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.128220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.128499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.129300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:46.129616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.131057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.149293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 419/820] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:46.149293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.187472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 402/821] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:18:46.188160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.235673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.259544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45263dd9-a07a-4a2f-b4ef-91813a5a7df3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.261939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.292240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6382eb-f6e9-48fa-a82d-71a19bfb800b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.303278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.303964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.304804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.305141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.305916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:46.306228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.307595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.312397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 420/822] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:46.313152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.332619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.333574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.333859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.334133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.334833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:46.335138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.336643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.345995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 403/823] 10.222.0.71 () {56 vars in 1124 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:46.345995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.427737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0fb00-f5e1-4e5f-bd2f-bf36fe983ad2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.449171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0775b4-81ea-4d2e-9688-48acabd7e4d2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.459943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.465108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.466029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.466345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.466593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/fcd9230db6ae4c46b4cfb0e07a103949/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.468678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=fcd9230db6ae4c46b4cfb0e07a103949, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.470141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.485396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.486279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.486631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.486978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.498354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.499887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:46.516940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:46.517981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:46.518937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:46.518937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:46.518937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:46.518937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:46.518937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 404/824] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:46.519686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.577371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 421/825] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:18:46 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/fcd9230db6ae4c46b4cfb0e07a103949/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:18:46.577371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.640749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41054d-49da-4fb7-9129-fa35930bf761 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.673678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.681633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.682385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.682673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.682951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.683686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] RBAC: Adding query filter params (type=network) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:46.684078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.685641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.691900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 405/826] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:46.692942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.733546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7305-793a-49bb-8f68-e78cd9eeccbf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.734204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:46.796838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.797552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.797839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.798162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.798907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.800277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.832008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ffba6-67e8-498d-8f95-2e49f843ec9b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:46.869654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:46.870350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:46.870636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:46.870915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:46.871636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:46.871947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:46.873337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:46.890229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 406/827] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:46.890229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:46.961588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 422/828] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:18:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:46.964159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:47.006256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:47.039445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2df37-3158-465f-a9be-f54487847777 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:47.128216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:47.128900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.129180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.129486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.130401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:47.131871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:47.136541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:47.162906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf44ea-cbc6-446b-a167-8e4c0b6aa8f2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:47.205631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:47.206507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.206792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.207070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.214920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:47.216433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:47.234882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:47.235997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:47.237060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 423/829] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:47.245342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:47.251830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 407/830] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:18:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:47.365791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5ae47-2105-4a17-aee6-68825fff348a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:47.413117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:47.414575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.414826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.414925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.415725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:47.416038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:47.417532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35827a-374e-48db-9b89-16c162c034c6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:47.429816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:47.433040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 424/831] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:47.438658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:47.568449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199564b5-5444-4982-a207-68a4e8c850ad None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:47.605895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:47.606574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.606858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.607137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.607983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:47.608298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:47.609786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375500a3-62fe-4998-aab2-065dc50b459f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:47.617048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 408/832] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:47 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:47.732551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820014e-6d5f-4232-8ec0-52ba8f6b8c8b None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.732906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820014e-6d5f-4232-8ec0-52ba8f6b8c8b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.733101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820014e-6d5f-4232-8ec0-52ba8f6b8c8b None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.734472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 425/833] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:47.740348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:47.740662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:47.740921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:47.746953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:47.764357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:47.765921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:47.852341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 409/834] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:47.877590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820014e-6d5f-4232-8ec0-52ba8f6b8c8b None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:47.996545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820014e-6d5f-4232-8ec0-52ba8f6b8c8b None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.033582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.034389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.034677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.034953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.046849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:48.055758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:48.056702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:18:48.057569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:48.061291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 426/835] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:18:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:48.063167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.171263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad396b-0d80-45ff-9876-4ec5253c2552 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.201641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:48.206601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.207272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.207557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.207838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.208835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:48.209141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:48.210607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:48.219972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 410/836] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:48.225019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.290345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:48.333682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bfe638-67fc-4f0c-b724-ca6d1f07a0b3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.370049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.370855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.371140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.371415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.382852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:48.384810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:48.403608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:48.404533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:48.405457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:48.405457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:48.405457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:48.405457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:48.405457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 427/837] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:48.410707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.524369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0692f-0921-4846-9b79-5a0d64a9ab5d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.560655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.561243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.561552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.561829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.562564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:48.562863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:48.564249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:48.577911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 411/838] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:48.583598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.695879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdaa082-261d-4712-9ec5-924c33ebdf49 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.709355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:48.731146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.731970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.732256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.732536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.740218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:48.742297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:48.758658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:48.759787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:48.760918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 428/839] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:48.765776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.835736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:48.889570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e342bb-0b30-4af2-8023-35a4aa895467 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:48.924726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:48.925427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.925712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.925987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.926825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:48.927137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:48.928572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9724dd-4abe-47e9-93d4-f480365c0dfc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:48.947694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 412/840] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:48.952949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:48.996244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273185c-6966-4768-b600-6908e9115ced None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:48.996567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273185c-6966-4768-b600-6908e9115ced None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:48.996812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273185c-6966-4768-b600-6908e9115ced None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:48.998490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 413/841] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:49.006764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.007057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.008027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.025644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:49.026835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:49.071464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc91d5-7ad8-4f21-bc98-8ad1dc8715a7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.099286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 414/842] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:49.113459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.114125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.114411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.114688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.123689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.161294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.189348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.189930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.190979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.231135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180519-cc56-4b6e-8768-98d89691c317 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.270372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.271286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.271642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.272016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.286691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:49.295234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:49.296372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:18:49.297483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:49.299216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 415/843] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:49.305395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 429/844] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:18:49.310017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.310263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.383557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.421889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12d50d-b71a-4b3f-a8ae-c0e1ad200075 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.425600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.428632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed05884-e421-49cc-aa0e-c2cff0cb4de5 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.459194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.459967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.460758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.461159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.462089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:49.462402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.463784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.466453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.467260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.467549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.467826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.473356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 416/845] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:49.479455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.485933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.488740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:49.514085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:49.515088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:49.515978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:49.515978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:49.515978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:49.515978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:49.520240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 430/846] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:49.521390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.624735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841275b-8f37-451b-aba9-391007163e15 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.655551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95859de7-f829-45ce-82ba-bac3e838dafc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.662843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.669225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.669225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.669225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.676186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.677714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.683706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.695952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.699873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.699873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.699873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.699873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-dabdf377-5ba5-4304-a0d5-3688cf879109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:49.700199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:49.701038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:49.703781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:49.703781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:49.703781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:49.703781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:49.706168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.706268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 417/847] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:49.706268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2403c5-0c79-4088-9c81-83df4719feb4 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.706268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2403c5-0c79-4088-9c81-83df4719feb4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.706268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2403c5-0c79-4088-9c81-83df4719feb4 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.706268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 418/848] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:49.706579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c46113-bf02-482c-b5f1-3eef027788b1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.707850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2403c5-0c79-4088-9c81-83df4719feb4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.729424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 431/849] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:49.729424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.729424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.729424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.734349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.745080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:49.749195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:49.818806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 432/850] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:49.820400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.824878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2403c5-0c79-4088-9c81-83df4719feb4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.865444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.866114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.866401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.866909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.868049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:49.868350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.869875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.887374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 419/851] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:49.887374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:49.942941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44bbad-c9c7-4b01-9122-07f12d3efa37 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:49.959545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.974177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:49.983317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:49.984335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:49.984787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:49.985331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:49.992689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:49.994340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:49.998066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec5505b-6961-4ee3-a4fd-9ba7d6fa3049 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:50.008874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:50.014852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 433/852] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:50.015798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.043475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.044280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.044565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.044839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.045517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.046879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:50.058495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:50.059636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:50.060525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 420/853] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:50.061384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.119041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f4864-4560-44ec-b49b-c955b83de429 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.151952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.152749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.153033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.153346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.160677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.161656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e6804-eb03-4621-a085-e795a0d85c71 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.162146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-c7378f24-12a9-4025-8bdc-854dd87a4a23 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:50.176770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:50.177842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:50.178812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 434/854] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:50.179628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17868-eb75-492d-bb99-a09f34d570a6 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.179727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17868-eb75-492d-bb99-a09f34d570a6 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.179924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a17868-eb75-492d-bb99-a09f34d570a6 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.181349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 435/855] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:50.181879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17868-eb75-492d-bb99-a09f34d570a6 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.200824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.201439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.201721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.201992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.202766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.203074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.204498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.214241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.217371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.217485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 421/856] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:50.218194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.287778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a17868-eb75-492d-bb99-a09f34d570a6 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.315512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bf4ce-3ec2-46eb-b929-8997739d43b5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.322288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.322951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.323234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.323511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.324209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.324519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.325904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e9141-fa1a-441e-9a17-6d21723bac0c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.330573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 436/857] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:50.331729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.332018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.332297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.350330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.351590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.351868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.352139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.353147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.353491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.354922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.355832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:50.357023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:50.373353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 422/858] 10.222.0.71 () {56 vars in 1135 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:50.374176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.431874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.432907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 437/859] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:50.433817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.462999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.475090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f2d5d-b064-4587-9ca1-ac1b022a5e0f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.510324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.510977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.511259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.511536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.512366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=e9a0738758e145e28f087b36ded06e48) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.512675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.514129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.520657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 423/860] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/role_assignments?user.id=e9a0738758e145e28f087b36ded06e48&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:50.523700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.537743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ad97c-1138-4376-9c29-831aca31f820 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.579137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.579827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.580121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.580401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.581146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.581570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.583253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.601291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 438/861] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:50.601291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.689459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4041a-0f0b-4d03-a02b-bc472b81f278 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.720145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.733786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:50.741230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.743325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.744133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.744625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.746015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae307b00-39b2-48f1-b410-a1ac7bb8c050 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.791164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.792602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.793097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.793483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.794988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.795772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:50.811281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:50.812499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:50.813618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:50.815899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 439/862] 10.222.0.71 () {56 vars in 1132 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:50.824318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.843313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:50.845083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:50.952024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d86764-c4a6-4cf3-909c-852deb86a5a7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:50.980400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 424/863] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:18:50.985566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:50.994396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:50.995927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:50.996426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:50.996926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:50.998377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:50.998912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.001196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.008798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 440/864] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:51.015807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:51.017800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:51.048430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:51.103298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c20b64-620a-4098-8ccf-49907be22643 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.141423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.142213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.142501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.142779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.154625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.155328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5828f-b428-4650-b4ff-8971358a1dd2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.156465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:51.176741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:51.177757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:51.178686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:51.178686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:51.178686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:51.178686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:51.178686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 425/865] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:51.184282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:51.201459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.202798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.203299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.204309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.208621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:51.209691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.212275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.226292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 441/866] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:18:51 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:51.280456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:51.308596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083a1e0-14cb-487f-8670-49b9f9876a76 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.347432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.348103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.348386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.348659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.349412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:51.349717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.351902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.370706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 426/867] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:51.372151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:51.464458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:51.480515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a38da-2609-4267-9b3c-2f2bde3f31a8 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.520149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.521478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.522067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.522550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.530638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.532027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:51.546752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:51.547670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:51.548790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 442/868] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:51.555923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:51.662077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f5b017-dd9e-4325-a26c-2129da5c4b1f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.698401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.699069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.699351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.699625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.700415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:51.700724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.702188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e24f9-5d49-4b8d-bf58-e09e3f91207f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.703856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:51.715571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 427/869] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:51.721609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:51.842296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2951a-c1cd-4078-89bf-9e2e59d7157f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:51.880242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:51.881146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:51.881693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:51.882157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:51.883410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=fcd9230db6ae4c46b4cfb0e07a103949) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:51.883895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:51.885506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb42905-97ee-40bc-9101-28e0d4135f34 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:51.892505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 443/870] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:51 2022] GET /identity/v3/role_assignments?user.id=fcd9230db6ae4c46b4cfb0e07a103949&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:52.900542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d80c-1f60-41f9-b229-cf0ac67781cb None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:52.901098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d80c-1f60-41f9-b229-cf0ac67781cb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:52.901098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329d80c-1f60-41f9-b229-cf0ac67781cb None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:52.902615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 428/871] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:52.907986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:52.908381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:52.908561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:52.925796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8787-decd-4a3d-8e11-cc3fc5a323f3 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:52.925978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:52.926092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8787-decd-4a3d-8e11-cc3fc5a323f3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:52.926351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdc8787-decd-4a3d-8e11-cc3fc5a323f3 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:52.927063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:52.927982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 429/872] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:52.929447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:52.936518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:52.937090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:52.938092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:52.961776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:52.963489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:53.013296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 444/873] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:53.040850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.065404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 430/874] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:53.090260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.161074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381038ea-8915-403c-bb26-c445b9029b24 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.197552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1d2e-cbc8-4527-8cb5-3bf6cf33c393 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.197821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.198795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.199134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.199525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.211153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:53.219556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:53.220512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:18:53.221386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:53.222062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:53.225577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 445/875] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:18:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:53.226902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.232174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:53.246252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.247196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.247469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.247750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.248492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:53.250511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:53.333419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 431/876] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:18:53 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:18:53.349860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af815c05-e47b-42aa-b138-a801d74035eb None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.400740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.401882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.402506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.403032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.404099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:53.404637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:53.406433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f52d7-66b5-4fdb-b07e-27c622770180 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:53.418290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 446/877] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:18:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:53.425437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.543639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee53effc-6db4-426a-b647-d0096d72871f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.579451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.597368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.597368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.597368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.597368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:53.597368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:53.597767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6110d8-478a-4411-8af5-ce66d78ee96a None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.597767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6110d8-478a-4411-8af5-ce66d78ee96a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.598444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6110d8-478a-4411-8af5-ce66d78ee96a None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.600293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 447/878] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:53.606495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.607077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.607613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:53.614811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:53.615713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:53.617281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:53.617281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:53.617281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:53.617281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:53.617281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 432/879] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:53.624530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.631657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:53.632887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:53.680734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:53.699497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:53.721171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 448/880] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:53.748039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.775282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618427f-5ac6-4707-a185-58bb77b6ab4a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.823290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.824185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.824484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.824770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.826263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:53.826636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:53.828660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:53.844542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 433/881] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:53.849741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:53.879442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2cf5c8-35dd-4dd9-8386-4b5594fd4dae None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:53.915188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:53.916276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:53.916793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:53.917389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:53.918443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:53.919904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a2663-c632-437e-88db-6780d1385a6a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:53.963298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:53.969383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03b313-e452-4eef-b2fd-22eabae44951 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.007733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.008281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.008545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.008816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.016349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.017815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:54.037292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:54.038728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:54.039927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 434/882] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:18:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:54.040868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 449/883] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:18:53 2022] POST /identity/v3/services => generated 269 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:18:54.044079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.158864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292e950-a1c6-4b10-b88a-c4cf1de75298 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.176290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14f88-a939-44fc-af43-43947a202ae7 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.176583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14f88-a939-44fc-af43-43947a202ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.176860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c14f88-a939-44fc-af43-43947a202ae7 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.180686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 450/884] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:54.185448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.185741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.186003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.203245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:54.204454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:54.214172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.214776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.215055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.215328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.216777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:54.217110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.218633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.245406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 435/885] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:54.251215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.262822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.266075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.297900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 451/886] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:54.316341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.384312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e17fe-902c-4e72-b452-467bfaa3a308 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.426214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20897-c38c-4beb-8858-02d25a49fc2d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.435864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.436823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.437347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.437828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.467009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.467739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.468017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.468346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.469091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.470426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:54.485237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:54.486298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:54.487137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 452/887] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:54.493000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.524916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.526961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.540690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.551457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.615196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15805a4c-e79f-406e-bce2-ddfcf7118c60 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.644321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 436/888] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:18:54.650107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.657152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.657877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.658168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.658447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.659164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:54.659472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.660933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.666432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 453/889] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:54.672352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.776519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cfffe-860d-4218-bfa3-8fe410d56d2f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.781251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd34f2f-e0c1-428b-9f4d-89f0743b2a7c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:54.783619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.789594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:54.812895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.814767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.815110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.815325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.819002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:54.819866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:54.820295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:54.820584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:54.821349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:54.821669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.823515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.825909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:54.827506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:54.837763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 454/890] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:54.847691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:54.848663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:54.849584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:54.849584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:54.849584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:54.849584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:54.849584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 437/891] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:54.858712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:54.976537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12b73c-c623-48b1-83f3-9304c91d3287 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:55.016765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:55.017487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.017776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.018056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.018796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:55.019105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:55.020538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:55.037631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 455/892] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:55.039918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:55.144676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4742f1-914c-46b7-91f6-33b899175b9a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:55.181037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:55.181864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.182422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.182697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.189712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:55.191147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:18:55.205136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:55.206096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:55.207261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 438/893] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:18:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:55.215009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:55.246856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:55.327896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a657e-6f16-48f3-8fb9-a72ad2e3a915 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:55.364472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:55.365539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.366056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.367155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.368178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:55.368695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:55.370365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5284ef-e86d-4dfb-959f-ae0ebc602407 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:55.388498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 456/894] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:18:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:55.390398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:55.417816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:55.498942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8cb79-3381-4b79-a856-dd4616397846 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:55.541295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:55.541295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.541295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.541650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.545288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] RBAC: Adding query filter params (role.id=2a4773bb62a9434ba9e85c7f72a3d89f, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=e9a0738758e145e28f087b36ded06e48) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:55.545288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:55.545288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781858f-494e-4ca5-8978-d18b0204b902 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:55.550383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 439/895] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:18:55 2022] GET /identity/v3/role_assignments?user.id=e9a0738758e145e28f087b36ded06e48&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=2a4773bb62a9434ba9e85c7f72a3d89f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:18:55.711648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76dce-99a8-4ed4-b634-b83732b63da4 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.712025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76dce-99a8-4ed4-b634-b83732b63da4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.712235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76dce-99a8-4ed4-b634-b83732b63da4 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.713954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 457/896] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:55.719646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.720226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.720725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.739244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:55.740785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:55.812483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 440/897] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:55.835468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76dce-99a8-4ed4-b634-b83732b63da4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:55.933197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:55.949832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76dce-99a8-4ed4-b634-b83732b63da4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:55.987437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:55.988218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:55.988506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:55.988835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:55.989535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:55.991650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:56.004279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:56.005360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.006209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 458/898] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:56.014703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.033709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:56.125959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5aa3f0-bd3f-4341-8b99-bf09f495f4aa None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.163121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.164412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.164938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.165453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.166366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:56.166889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.168469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.174035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 441/899] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:56.180434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.297002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0804d-f00a-4690-8409-fe4a394cb071 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.334522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.335858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.336378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.336862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.337811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:56.338356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.339928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62da6f-fc14-4aa2-af08-8c2f6bcbbe0e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.345639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 459/900] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:56.352631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.441661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:56.459934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914efb8a-fd6a-42b2-8adb-a4d3a63d2134 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.460430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bc31-7a0a-4d7b-b89e-aa0a64bb5acd None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.460999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bc31-7a0a-4d7b-b89e-aa0a64bb5acd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.461287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7bc31-7a0a-4d7b-b89e-aa0a64bb5acd None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.462911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 460/901] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:56.470601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.470887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.471164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.493145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:56.495064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:56.498978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.499817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.500247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.500684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.501679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] RBAC: Adding query filter params (interface=public, service_id=9ef37495274146d88f679e74679096d1, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:56.502134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.503640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.508653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:56.509807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 442/902] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/endpoints?service_id=9ef37495274146d88f679e74679096d1&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:56.514813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.595674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 461/903] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:18:56.622733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.648879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afefc096-ec1c-40f4-a587-deb91525a331 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.687879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.688555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.688841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.689122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.689838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.691205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.705443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 443/904] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:18:56.743559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5e4f-35bb-44f2-b84e-951ddce9daad None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.785049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.786353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.786844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.787324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.788767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.790515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:56.804550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:56.805714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:18:56.806594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:18:56.809772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 462/905] 10.222.0.71 () {56 vars in 1132 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:18:56.815460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:56.827745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:56.934253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3386a5f-1d9e-4d59-ab2d-87492c62e4e4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:56.986211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:56.987368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:56.987869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:56.988356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:56.989705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:56.990244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:56.993276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:57.002197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 444/906] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:18:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:57.008599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:57.022677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:57.122079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655c5e7-9f35-4ae0-9894-b2e8950f68cf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:57.158886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:57.159552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.159832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.160116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.160809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:57.161128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:57.162742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50e8ac-e74c-410c-8f40-4f8e619d6c0c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:57.169132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 463/907] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:18:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:57.174931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:57.252026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:57.283052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b859b-aa01-4d89-bdce-50ccfdddca08 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:57.312068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87f5-4c86-4d5b-b0bb-1464e23c6de1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.312264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87f5-4c86-4d5b-b0bb-1464e23c6de1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.312498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc87f5-4c86-4d5b-b0bb-1464e23c6de1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.317370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 464/908] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:18:57.319190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.319660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.319991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.321388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:57.322291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.322771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.323242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.324227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] RBAC: Adding query filter params (interface=public, service_id=9fa5d98cd1a44fd98b691ccb0ee4ee97, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:57.324833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:57.326798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:57.333133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 445/909] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:18:57 2022] GET /identity/v3/endpoints?service_id=9fa5d98cd1a44fd98b691ccb0ee4ee97&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:57.339292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:57.339958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:57.340520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:57.421385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 465/910] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:57.436076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:57.439163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:57.449828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122d16a-4c3b-4477-9673-ae6944703c79 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:57.489652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:57.490770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.491311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.491979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.492892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:57.494585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691b7ea-1e09-42e4-ae30-de1c07dfd9a4 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:57.496910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:57.502960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 446/911] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:18:57 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:18:57.553041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba262d-ecaf-47ef-b40d-d6d18605e303 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:57.595585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:57.596278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:57.596568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:57.596850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:57.597663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:57.599180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7e8b7-fa30-472a-ad4f-4ca60d6eb2b9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:57.681465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 466/912] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:18:57 2022] POST /identity/v3/services => generated 241 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:18:58.098029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd409-98f1-4d66-a263-be15f7cf4712 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:58.098673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd409-98f1-4d66-a263-be15f7cf4712 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:58.099153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cd409-98f1-4d66-a263-be15f7cf4712 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:58.101809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 447/913] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:58.109817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:58.110287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:58.110777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:58.137632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:58.139588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:18:58.236953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:58.261920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 467/914] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:18:58.300695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd409-98f1-4d66-a263-be15f7cf4712 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:58.438154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295cd409-98f1-4d66-a263-be15f7cf4712 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:58.475088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:58.476537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:58.476987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:58.477437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:58.488251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:18:58.497139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:58.498243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:18:58.499174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:58.501409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 448/915] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:18:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:58.511165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:58.680951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c90a4-b20c-494a-99d1-f98ab66ed76c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:58.738385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:58.739940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:58.740692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:58.741993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:58.743635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:58.744510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:58.747287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:58.762909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 468/916] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:18:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:58.775665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:58.884526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:58.957133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf2eab-7b1e-4549-90f2-bd7382a5ec2f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:59.015410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:59.016663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.017148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.017653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.029661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:59.031513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:59.049460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:59.051111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:59.052853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:59.052853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:59.052853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:59.052853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:59.052853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 449/917] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:59.063202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:59.154014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:59.232894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce0b76-6043-4d23-8179-536dd8908cde None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:59.270789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:59.271382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.271664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.271943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.272930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:59.273243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:59.274670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:59.287146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 469/918] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:59.295672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:59.470864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f9fff-20af-4ea2-bfd0-2a9c6b7c1cbc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:59.493526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:59.532450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:59.533306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.533599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.533877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.544070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:59.545710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:18:59.562238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:59.563245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:59.564220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 450/919] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:18:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:59.569591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:59.675357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f9ef2a-a6d4-48fa-8c23-a2f4552f83fc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:59.689447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:18:59.712245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:59.712926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.713214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.713544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.714382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:18:59.714699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:59.716135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:59.735047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 470/920] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:18:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:18:59.740372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:59.860200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6ecbf-aa7c-4323-b80c-d005be725792 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:18:59.899421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:18:59.900505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.900937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.901412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.914645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:18:59.916418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-57a47305-bc60-40dc-9d59-1a3f9c7c58a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:18:59.938889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:18:59.940027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:18:59.941132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:18:59.941132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:18:59.941132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:18:59.941132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:18:59.943091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 451/921] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:18:59.948875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:18:59.956472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da1755-1f9e-4c8f-a82a-98bf25e67818 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.956763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da1755-1f9e-4c8f-a82a-98bf25e67818 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.957041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da1755-1f9e-4c8f-a82a-98bf25e67818 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.958919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 452/922] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:18:59.964561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c6d0-00f4-43a6-97a5-43c987b7b012 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:18:59.964850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c6d0-00f4-43a6-97a5-43c987b7b012 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:18:59.965126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6103c6d0-00f4-43a6-97a5-43c987b7b012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:18:59.982595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6103c6d0-00f4-43a6-97a5-43c987b7b012 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:18:59.983771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6103c6d0-00f4-43a6-97a5-43c987b7b012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:00.009420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.072197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 453/923] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:18:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:00.072384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35e9659-356f-4080-a8da-ceab386ca714 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.083169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a36ac-62a6-4f01-9719-4b4668ede356 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.083461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a36ac-62a6-4f01-9719-4b4668ede356 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.083867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a36ac-62a6-4f01-9719-4b4668ede356 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.086098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 454/924] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:00.091407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d3449-ea12-49a6-a4a3-60fd37b6f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.091727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d3449-ea12-49a6-a4a3-60fd37b6f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.092007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d3449-ea12-49a6-a4a3-60fd37b6f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.109161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.109822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0a9d3449-ea12-49a6-a4a3-60fd37b6f7f6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:00.109934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.110125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.110448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.111005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0a9d3449-ea12-49a6-a4a3-60fd37b6f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:00.111115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.111394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.112750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.125510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 471/925] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.126308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.157442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.180597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 455/926] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:00.180866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc941-a411-41f1-822e-cd9822bfe0b1 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.181134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc941-a411-41f1-822e-cd9822bfe0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.181426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cc941-a411-41f1-822e-cd9822bfe0b1 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.185669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 456/927] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:00.185669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc941-a411-41f1-822e-cd9822bfe0b1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.235080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0bc1e-6857-4931-96bc-38273dae0581 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.269945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.270948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.271223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.271494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.272228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.274174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.276899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b4e963fa-991b-4ed9-bc34-d37cb6ce4875 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:00.285572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:00.289836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.290703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 472/928] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:00.291501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.291501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.291501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.294021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cc941-a411-41f1-822e-cd9822bfe0b1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.306536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:00.307707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:00.333701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.334498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.335493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.335828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.344493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.345965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:00.361800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:00.362740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:00.363665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 457/929] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:00.364169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.378764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 473/930] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:00.379592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.403983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.471030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d907707-b55d-457d-9c35-c2ba63dcd3dc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.481021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83099a8-d716-4e2d-a195-e4e986e27258 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.504530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.505365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.505653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.505928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.506636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.507998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.514195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.514855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.515136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.515416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.516110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.516413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.517793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:00.519986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:00.520916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:00.522894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 458/931] 10.222.0.71 () {56 vars in 1132 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:00.523878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.528733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 474/932] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.529592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.537168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.618212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.626291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a17bed-4731-4162-a5d5-5bf615ff1df3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.631041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccf411-271e-42bd-b462-c2f306e50ba9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.660462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.661118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.661442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.661729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.662622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.663584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.665151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.666950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.667760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.668036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.668308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.668946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.670324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.677382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 459/933] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.678177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:00.682933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:00.683941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:00.684818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 475/934] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:00.685657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.746531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.778487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658d287-c561-42a0-8ce1-be8ba8b3783d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.784351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42affdc2-4e38-4495-be39-79a3cf63282e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.813180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.813885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.814175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.814455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.815160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.815468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.816835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.817562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.818227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.818520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.818800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.820116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.820422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.821796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.822566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 460/935] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.823170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.831037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 476/936] 10.222.0.71 () {56 vars in 1114 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.831816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:00.849675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.927442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd36481-6a97-48dc-b1fa-c5915b295cd2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.931370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e78030-165e-474d-b114-be1343594a97 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:00.956398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:00.961687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.962568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.962850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.963124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/e9a0738758e145e28f087b36ded06e48/roles/2a4773bb62a9434ba9e85c7f72a3d89f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.965008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:00.965308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=e9a0738758e145e28f087b36ded06e48, role_id=2a4773bb62a9434ba9e85c7f72a3d89f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.970145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:00.970145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:00.970145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:00.970511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.970588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:00.970588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:00.970588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:00.973314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 477/937] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:00.974089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.054670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:01.073936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3300e-c474-48ca-be14-eee866df4678 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.079462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 461/938] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:19:00 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/e9a0738758e145e28f087b36ded06e48/roles/2a4773bb62a9434ba9e85c7f72a3d89f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:01.080275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.110661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.111351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.111637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.111915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.112638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:01.112949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.114398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.125444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 478/939] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:01.125444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.212469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80577a45-8dc5-4c29-bc4e-aad1977dcb38 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.235169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758686f8-374a-4248-9a19-edaa2df10cc8 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.251520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.252659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.253205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.253786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.254773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.256567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.283916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.284591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.284878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.285158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.285895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:01.286208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.287671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.292693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 479/940] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:01.293728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.304943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:01.335299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 462/941] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:01.336538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.399137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:01.432284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ceea9c-b43d-478f-993d-d45ad3e2c949 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.467335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce8567-a1fb-40b5-ad81-d3cdb6f843eb None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.483131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.484526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.485025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.485695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.487019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.488835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2c0be8-e77e-4d4f-99eb-2300ee3b4b03 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.508534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.509304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.509548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.509825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.510634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] RBAC: Adding query filter params (interface=public, service_id=31bb546284854dcf934a7b7543ee498f, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:01.510951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.512345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.519049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 463/942] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:19:01 2022] GET /identity/v3/endpoints?service_id=31bb546284854dcf934a7b7543ee498f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:01.525517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:01.607487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 480/943] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:01.641831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048c996-5bcb-4faa-aba4-c09b5caef213 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:01.653328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:01.687784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:01.688462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:01.688742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:01.689018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:01.689838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:01.691261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4a2ee-68e2-45e3-b99e-d07574455a94 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:01.699434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 464/944] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:19:01 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:19:03.355062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0061a-b2c0-4a89-99f9-46a6be6a763c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.355588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0061a-b2c0-4a89-99f9-46a6be6a763c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.355588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0061a-b2c0-4a89-99f9-46a6be6a763c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.357214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 481/945] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:03.362788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.363252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.363331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.381139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:03.383717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:03.456190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 465/946] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:03.481031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0061a-b2c0-4a89-99f9-46a6be6a763c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:03.555538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:03.599345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0061a-b2c0-4a89-99f9-46a6be6a763c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:03.637178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:03.638512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.638800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.639081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.650632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4048ed69-1aac-4442-819e-ed04568b2a92 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:03.659163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:03.660086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:03.661080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 482/947] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:19:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:03.668770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:03.674818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef47d-05bd-4ab6-a1fc-c265e4c8bfd6 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.675115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef47d-05bd-4ab6-a1fc-c265e4c8bfd6 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.675400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ef47d-05bd-4ab6-a1fc-c265e4c8bfd6 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.677695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 483/948] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:03.682742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.683036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.683363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.700743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:03.701971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:03.781401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 484/949] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:03.800853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:03.805531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c1b213-6238-4b76-a880-48bc3ae7bc61 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:03.810538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:03.852502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:03.853597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.854092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.854570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.855641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:03.856261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:03.858036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:03.868417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 466/950] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:19:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:03.876454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:03.878618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:03.923725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6791e71-bd38-4403-9fc7-f7efdb26e20a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:03.962416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:03.963117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:03.963406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:03.963684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:03.964520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:03.966085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:03.967476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING keystone.server.flask.common [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 03:19:03.984377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6383d-8bf2-42ae-a6e7-71437ea497e8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.015951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.sql.core [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:19:04.015951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 03:19:04.015951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [parameters: {'id': '557715e149e74e62876533c0ba4e6db0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 03:19:04.015951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:19:04.018146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.018933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.019211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.019482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-0231f1d9-fd79-4b84-a944-65efe772b8ee None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 557715e149e74e62876533c0ba4e6db0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 557715e149e74e62876533c0ba4e6db0. May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application conn.query(q) May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:19:04.024113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result.read() May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 03:19:04.024974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application next(self.gen) May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application yield resource May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application next(self.gen) May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise self.value May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application session.commit() May 27 03:19:04.025969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.session.flush() May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application compat.raise_( May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:19:04.027768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:19:04.029845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application conn.query(q) May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application result.read() May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:19:04.031587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [parameters: {'id': '557715e149e74e62876533c0ba4e6db0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.034100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.036847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 557715e149e74e62876533c0ba4e6db0. May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 485/951] 10.222.0.71 () {60 vars in 1140 bytes} [Fri May 27 03:19:03 2022] POST /identity/v3/projects => generated 262 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f07-544f-4674-a3eb-cf33a56d2e27 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.039576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f07-544f-4674-a3eb-cf33a56d2e27 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea280f07-544f-4674-a3eb-cf33a56d2e27 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 486/952] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04345fa-d36e-4554-b674-5177a4404511 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04345fa-d36e-4554-b674-5177a4404511 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04345fa-d36e-4554-b674-5177a4404511 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 487/953] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:04.041879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04345fa-d36e-4554-b674-5177a4404511 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.042440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.042440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-68255465-bef7-4198-b6a9-abe9bec03f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:04.056901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:04.058261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 467/954] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43391b0-9ec4-4cb1-aaa9-ae5784ffe54e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43391b0-9ec4-4cb1-aaa9-ae5784ffe54e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.061070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43391b0-9ec4-4cb1-aaa9-ae5784ffe54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.076340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d43391b0-9ec4-4cb1-aaa9-ae5784ffe54e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:04.077533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d43391b0-9ec4-4cb1-aaa9-ae5784ffe54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:04.085653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.142381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04345fa-d36e-4554-b674-5177a4404511 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.144118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 468/955] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:04.145471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.145756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.146025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.161571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.162380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:04.163695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:04.189464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.189464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.189464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.189464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.198341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.200268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:04.215307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:04.216291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 488/956] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:04.217331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.236046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 469/957] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:04.236994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.315412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.325301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc0093-891a-4c55-86a6-baef3e8492f2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.345471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6054fb-e8d3-4f2e-ba88-19a09a22c491 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.358190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.358854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.359154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.359415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.360132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:04.360439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.361843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.376162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 489/958] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:04.376982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.379733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.380537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.380817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.381090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.381951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.383316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.395391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:04.396468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.398475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 470/959] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:04.399457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.411074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.481180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0153554-ad95-490c-ab10-3eeb53abe874 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.496873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16a6d-dc83-4dbd-9563-88ca304bf686 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.515212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.515875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.516165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.516467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.517250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:04.517599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.519037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.530468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.531265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.531549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.531825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.532480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.533869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.537810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.539968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 490/960] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:04.540826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.549158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:04.550286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:04.557379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 471/961] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:04.559974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.646036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.658792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d8340-53a1-4a5e-94cb-5eb062a844b7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.674864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15988a4-fd08-4395-9390-776f6caf6da7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.700642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.701885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.702422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.703256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.712790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.713861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.714283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.714601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.714890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.715167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.715888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:04.716194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.717599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.722927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 472/962] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:04.723743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:19:04.731782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:04.732794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 491/963] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:04.735252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.800186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:04.843370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f7ab1f-7e60-43a6-b0e0-bfebd750ef95 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.851820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eb8f8a-f1e0-4ab0-9697-b0ff70e6cd66 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:04.880194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.880857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.881760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.882089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.882729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:04.883035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.884445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.893704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 473/964] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:04.893704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.895688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:04.896373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:04.896663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:04.897683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:04.898672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:04.899191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:04.901056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:04.908168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 492/965] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:04.909160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:04.925761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.013316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb24e2-9c1f-405a-bdb6-de6c07f0894a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.016412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dcfd85-d896-458b-a0cd-38e948c97774 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.041083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.049982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.053746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.053746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.053746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.053746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:05.053746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.054676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.055099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.055774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.056063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.056345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.057054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:05.057403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.058807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.073589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 493/966] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:05.073589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:05.074340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 474/967] 10.222.0.71 () {56 vars in 1149 bytes} [Fri May 27 03:19:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:05.080670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:05.186756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.211866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaee35-0c6c-4b64-ae8c-c775991d62dd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.214621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef572e7b-4c3d-419c-b061-80ef8baf773e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.260484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.261170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.261486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.261768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.262514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.263589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.264020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.264729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.265013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.265315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.330707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.344807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.346498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.385385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 494/968] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:05.490524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 475/969] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:05 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:19:05.496654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:05.633869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893a338-e577-4e19-bf96-4783d85a51bb None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.664579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.670926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.671732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.672013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.672283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.682726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.684243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:05.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:05.704079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:05.705072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:05.705072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:05.705072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:05.705072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:05.705072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 495/970] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:05.710535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:05.804946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:05.820018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432a65-2664-47c5-912c-025de9e163d7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:05.859290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:05.859964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:05.860246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:05.860522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:05.861248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:05.861586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:05.862952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:05.876052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 476/971] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:05.882425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:05.985889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83e531-27df-4df1-815e-2f4cf195e64f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:06.022825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:06.023988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:06.024440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:06.024717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:06.032969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:06.034835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:06.053002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:06.054152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:06.055199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:06.059260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 496/972] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:06.060618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:06.176794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9521663c-93ce-487e-a7f9-8f60feab57c6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:06.220817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:06.221541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:06.221827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:06.225284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:06.225284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:06.225284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:06.225284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d5a09-4482-41f9-a99b-a05a72aec7e5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:06.244647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 477/973] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:06.246019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:06.299702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:06.369245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3164b32-d6d4-46af-81cc-dd7d4a1b7e4a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:06.417669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:06.418444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:06.421290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:06.421290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:06.421290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] RBAC: Adding query filter params (role.id=2a4773bb62a9434ba9e85c7f72a3d89f, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=e9a0738758e145e28f087b36ded06e48) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:06.421290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:06.421604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d153998-8482-4710-8992-1a907ca2b434 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:06.437795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 497/974] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:06 2022] GET /identity/v3/role_assignments?user.id=e9a0738758e145e28f087b36ded06e48&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=2a4773bb62a9434ba9e85c7f72a3d89f => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:06.948332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52147f7a-d75e-41c3-94cc-e58aa3ce2118 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:06.948884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52147f7a-d75e-41c3-94cc-e58aa3ce2118 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:06.948884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52147f7a-d75e-41c3-94cc-e58aa3ce2118 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:06.950524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 478/975] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:06.955796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:06.956091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:06.956375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:06.974338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:06.976371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:07.046391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 498/976] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:07.072062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52147f7a-d75e-41c3-94cc-e58aa3ce2118 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:07.081197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:07.183556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52147f7a-d75e-41c3-94cc-e58aa3ce2118 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:07.220426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:07.221021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.221395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.221679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.222453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:07.223937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:07.225304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING keystone.server.flask.common [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 03:19:07.301809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.sql.core [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:19:07.301809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 03:19:07.301809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [parameters: {'user_id': '268f8b3904eb4708b3605f12d2b60ca2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 03:19:07.301809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80541) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-bb846b74-4912-4eda-847d-72ee7c051ef8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application conn.query(q) May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application result.read() May 27 03:19:07.319849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:19:07.320857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application next(self.gen) May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application yield resource May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application next(self.gen) May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self.session.rollback() May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self.force_reraise() May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise self.value May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application session.commit() May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 03:19:07.321874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._prepare_impl() May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self.session.flush() May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._flush(objects) May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application compat.raise_( May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application flush_context.execute() May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rec.execute(self) May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 03:19:07.322797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 03:19:07.323727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application result = self._query(query) May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application conn.query(q) May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application result.read() May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 03:19:07.324623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [parameters: {'user_id': '268f8b3904eb4708b3605f12d2b60ca2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:07.326817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 03:19:07.328725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:07.330628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 479/977] 10.222.0.71 () {60 vars in 1131 bytes} [Fri May 27 03:19:07 2022] POST /identity/v3/users => generated 160 bytes in 250 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:07.331119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:07.364204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:07.434376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba6d9c-974e-4869-a3a0-5fe306ea8223 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:07.470953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:07.471686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.471969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.472247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.479705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b44e4-2292-42d0-ab49-ba5f5a531c8e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.479977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b44e4-2292-42d0-ab49-ba5f5a531c8e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.480181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:07.480339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b44e4-2292-42d0-ab49-ba5f5a531c8e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.481565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:07.488842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 480/978] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:07 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:07.490123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.490409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.490409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:19:07.497620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:07.498982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:07.500215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 499/979] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:07.504863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:07.517710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:07.525145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:07.585675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:07.597396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 481/980] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:07.612813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:07.613825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:07.619680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3dd981-0821-4d3c-a84b-3346c8266527 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:07.657090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:07.657826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.658112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.659303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.660126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:07.660442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:07.663140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356116-ad43-4371-aaee-adad914fe5b5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:07.701934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 500/981] 10.222.0.71 () {56 vars in 1101 bytes} [Fri May 27 03:19:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:07.722260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c345384b-2f00-431a-9726-02b75b0cb828 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:07.774048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:07.774754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.775051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.775333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.776113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:07.778002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956d9a9-4712-4c6a-9e0c-df31c57705e2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:07.872751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 482/982] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:19:07 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:07.959986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfecef-c53e-4355-a334-361c89c31fe2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.960343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfecef-c53e-4355-a334-361c89c31fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.960532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfecef-c53e-4355-a334-361c89c31fe2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.962224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 501/983] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:07.968240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:07.968735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:07.968957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:07.987466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:07.988670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:08.053919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:08.076365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 483/984] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:08.099953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfecef-c53e-4355-a334-361c89c31fe2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:08.209875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfecef-c53e-4355-a334-361c89c31fe2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:08.245479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:08.246199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.246489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.246769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.247418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:08.248788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:08.261435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:08.262497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:08.263357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 502/985] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:08.270247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:08.375428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d5a81-287c-461a-9dcc-467047d31a8f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:08.412997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:08.413857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.414146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.414424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.415135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:08.415442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:08.416809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:08.426336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 484/986] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:08.427472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:08.448490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:08.541672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25789047-7cdd-40d4-aaa4-42ee04cb1f96 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:08.583356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:08.584026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.585043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.585339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.586148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:08.586412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:08.587789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:08.597503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 503/987] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:08.599323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:08.649998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:08.700946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd073a-7d0a-4056-b6d2-47e6a7c493ac None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:08.736633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:08.737316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.737603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.737878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.738680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] RBAC: Adding query filter params (interface=admin, service_id=31bb546284854dcf934a7b7543ee498f, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:08.738993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:08.740984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb38b8-5f3c-4836-b548-7013be4c42db None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:08.751689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 485/988] 10.222.0.71 () {56 vars in 1249 bytes} [Fri May 27 03:19:08 2022] GET /identity/v3/endpoints?service_id=31bb546284854dcf934a7b7543ee498f&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:08.753189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:08.842283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:08.861035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488424f0-529c-4450-b8a2-0e5fdae7187a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:08.896119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:08.896951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.897492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.897783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.898463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:08.899843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50aec5-87b1-4ace-b10a-04a55a5f76b8 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:08.913298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 504/989] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:19:08 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:19:08.946226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed55-0126-4845-a35b-97503aa67d39 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.946519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed55-0126-4845-a35b-97503aa67d39 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.946830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bed55-0126-4845-a35b-97503aa67d39 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.948266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 486/990] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:08.954132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:08.954420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:08.954701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:08.973004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:08.974289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:09.057305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 505/991] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:09.076253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bed55-0126-4845-a35b-97503aa67d39 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:09.184657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bed55-0126-4845-a35b-97503aa67d39 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:09.198567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:09.220827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:09.221646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:09.221925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:09.222192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] PATH_INFO: `/v3/services/image` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:09.222826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:09.224179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:09.236130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:09.237303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:09.238164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:09.244380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 487/992] 10.222.0.71 () {56 vars in 1105 bytes} [Fri May 27 03:19:09 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:09.246968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:09.328009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:09.352014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb878fc-5f8a-4186-964c-549dee374b9d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:09.386852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:09.387527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:09.387807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:09.388090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:09.388797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] RBAC: Adding query filter params (name=image) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:09.389109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:09.390523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ae0e2-65be-4149-915a-187acf7d5931 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:09.400047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 506/993] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:09.401322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:09.508982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e150132-9c07-48ce-a15b-6ae200aec08b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:09.548971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:09.549676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:09.549959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:09.550233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:09.550935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:09.551238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:09.552594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71117eac-0971-4161-81cf-f943e47536c6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:09.565532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 488/994] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:10.126848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5aa6-de9d-4284-9c67-bf716d9bc27b None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.127367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5aa6-de9d-4284-9c67-bf716d9bc27b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.127446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f5aa6-de9d-4284-9c67-bf716d9bc27b None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.128905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 507/995] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:10.134635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.135047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.135213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.152852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:10.154044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:10.188251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:10.221392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 489/996] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:10.244012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5aa6-de9d-4284-9c67-bf716d9bc27b None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:10.345231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f5aa6-de9d-4284-9c67-bf716d9bc27b None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:10.379157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:10.379868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.380147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.380420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.381701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:10.383193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:10.394828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:10.395790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:10.396809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:10.400957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 508/997] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:10.402237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:10.505759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ce40a-8899-410a-acbd-e95044a0e7a2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:10.548316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:10.548987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.549293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.549577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.550278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:10.550611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:10.551968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:10.562052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 490/998] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:10.563584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:10.568450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:10.670155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b639e6dc-f04a-4d98-86bd-4c7f7f768211 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:10.705162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:10.705865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.706146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.706421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.707119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:10.707428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:10.709197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:10.719048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 509/999] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:10.720389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:10.757456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:10.824633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e204889-9c3c-40af-add2-0511137618ca None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:10.859539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:10.860198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:10.860480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:10.860752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:10.861563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] RBAC: Adding query filter params (interface=public, service_id=a691ef515e7f49a0805f052aeb9d1e34, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:10.861873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:10.863226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ff7b2-4af5-4788-9cdd-c53e15739809 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:10.873318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 491/1000] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:19:10 2022] GET /identity/v3/endpoints?service_id=a691ef515e7f49a0805f052aeb9d1e34&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:10.874815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:10.944356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:10.979383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfaab86-1d01-4b20-8bc2-a1f05a4e200c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:11.016268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:11.016967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.017284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.017561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.018251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:11.019674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310d722-fc92-410e-9ad3-3be3fe5eb7c5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:11.033296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 510/1001] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:19:10 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:19:11.211184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d375a-bf29-42b0-b617-e1750abe24d8 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.211672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d375a-bf29-42b0-b617-e1750abe24d8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.211672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d375a-bf29-42b0-b617-e1750abe24d8 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.213304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 492/1002] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:11.218643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.219047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.219284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.237881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:11.239087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:11.309737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 511/1003] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:11.332886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d375a-bf29-42b0-b617-e1750abe24d8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:11.433340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:11.438762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d375a-bf29-42b0-b617-e1750abe24d8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:11.475213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:11.476054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.476336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.476615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.477332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:11.478694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:11.491532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:11.492687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 27 03:19:11.494196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:11.497333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 493/1004] 10.222.0.71 () {56 vars in 1126 bytes} [Fri May 27 03:19:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:11.498818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:11.570477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:11.616330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64e807-7e98-4d46-9654-ea64a5043237 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:11.651548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:11.652265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.652550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.652826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.653553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:11.653869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:11.655369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12699d94-09a4-4eea-85a0-63542dc23e92 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:11.665573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 512/1005] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:11.667376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:11.774325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f419a-9591-47f1-8532-349c68417991 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.774571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f419a-9591-47f1-8532-349c68417991 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.774820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387f419a-9591-47f1-8532-349c68417991 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.776305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 513/1006] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:11.777099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091cfc-2563-4aa2-b5d0-dc851e20e09f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:11.781242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.781556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.781833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.799693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:11.800969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:11.818245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:11.819353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.819646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.819940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.820673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:11.820985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:11.822410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:11.832177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 494/1007] 10.222.0.71 () {56 vars in 1122 bytes} [Fri May 27 03:19:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:11.833501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:11.863522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:11.879783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 514/1008] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:11.903404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:11.947495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d18e789-87cc-4f09-bcbe-3f1f313d2a85 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:11.964868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:11.983656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:11.984425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:11.984697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:11.985011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:11.985790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:11.987158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3412d-67b1-4112-a2f6-3ce5537eacfe None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:12.010360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df165cd-1c77-49fa-add1-24d563a92670 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:12.043688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:12.044260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:12.044542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:12.044817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:12.045553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:12.046961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77174-bb5b-4a74-8bc2-7c6f07ffe3fd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:12.055575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 495/1009] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:12.148942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 515/1010] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:19:11 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:13.291898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fe16f-b82f-4fcc-9aad-d7f4e9d0346d None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:13.292425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fe16f-b82f-4fcc-9aad-d7f4e9d0346d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:13.292425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35fe16f-b82f-4fcc-9aad-d7f4e9d0346d None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:13.294031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 496/1011] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:13.299111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:13.299513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:13.299677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:13.316995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:13.318251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:13.395632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 516/1012] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:13 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:13.418660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fe16f-b82f-4fcc-9aad-d7f4e9d0346d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:13.511140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:13.534571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35fe16f-b82f-4fcc-9aad-d7f4e9d0346d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:13.571771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:13.572519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:13.572803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:13.573082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:13.573768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:13.575182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:13.587715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:13.592219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 03:19:13.593106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:13.594830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 497/1013] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:13.595804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:13.640040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:13.697822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1b42fa-4997-45b7-a2a1-94ccd342d06d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:13.733280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:13.734351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:13.734785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:13.735224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:13.736075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:13.736529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:13.738066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:13.744360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 517/1014] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:13.750045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:13.857436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfcd47-4a8d-4daa-907d-ed03848c392b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:13.893850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:13.894480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:13.894764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:13.895040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:13.895753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:13.896054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:13.898206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a24e2-0b1b-4dec-a2fb-d267bb34fa8b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:13.903783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 498/1015] 10.222.0.71 () {56 vars in 1112 bytes} [Fri May 27 03:19:13 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:13.909661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.016650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c19da-4481-4c8e-abe6-f3a37ea0bb93 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.024335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:14.051297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.051969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.052252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.053040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.053825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:14.055204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d09fdb-d47c-415a-a6f3-f642bc86bd10 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:14.137289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 518/1016] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:13 2022] POST /identity/v3/endpoints => generated 334 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:14.278390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684daa3-bf60-4b1a-b308-47e1d6a1bc7b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.278723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684daa3-bf60-4b1a-b308-47e1d6a1bc7b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.278946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684daa3-bf60-4b1a-b308-47e1d6a1bc7b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.280328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 499/1017] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:14.286102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cacf1-ff27-4cb4-a75a-2c69798ac92a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.286502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cacf1-ff27-4cb4-a75a-2c69798ac92a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.286874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cacf1-ff27-4cb4-a75a-2c69798ac92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.304766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e72cacf1-ff27-4cb4-a75a-2c69798ac92a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:14.305987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e72cacf1-ff27-4cb4-a75a-2c69798ac92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:14.384395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 519/1018] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:14.393643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17179d-07ed-4d5e-8a7a-6a34a9f616c1 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.394130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17179d-07ed-4d5e-8a7a-6a34a9f616c1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.394130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17179d-07ed-4d5e-8a7a-6a34a9f616c1 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.395592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 500/1019] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:14.401552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.401848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.402129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.409554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17179d-07ed-4d5e-8a7a-6a34a9f616c1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.419866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:14.421064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:14.429660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:14.497765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 520/1020] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:14.519962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.535882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17179d-07ed-4d5e-8a7a-6a34a9f616c1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.543446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:14.573596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.574819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.575376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.575659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.576994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:14.578761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:14.581245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 501/1021] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:14.586815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.629311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d4f95-d9a3-412a-9be2-c6af0a3e7c59 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.669062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.670229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.670711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.671178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] PATH_INFO: `/v3/services/image` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.672017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:14.674035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:14.680345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:14.689480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:14.697204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:14.698275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 521/1022] 10.222.0.71 () {56 vars in 1105 bytes} [Fri May 27 03:19:14 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:14.699304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.702747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f03b66-5978-4d31-a09f-a30469a1ae40 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.742379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.743045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.743327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.743600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.744310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:14.745785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:14.784042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:14.802402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64e20a-7414-4b59-bc4c-ffb547e6a5da None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.823747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 502/1023] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:19:14 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:14.839592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.840557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:14.840853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:14.841131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:14.841897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] RBAC: Adding query filter params (name=image) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:14.842212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:14.843634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:14.854850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 522/1024] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:14.856336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:14.962915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd1bd6-453a-4a1c-bd49-d148b2f4b8d3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:14.999216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:14.999910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:15.000190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:15.000465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:15.001180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] RBAC: Adding query filter params (type=image) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:15.001517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:15.002916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:15.004449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:15.010829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 503/1025] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:15.016712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:15.125923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ba3107-3dfa-4273-9f26-180bc693f27e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:15.162520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:15.163179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:15.163467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:15.163744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:15.164532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] RBAC: Adding query filter params (interface=public, service_id=f6a397c0ef684151b683eaa3cb846dda, region_id=RegionOne) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:15.164844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:15.166295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd270b83-ab54-4c62-b978-8209e152faff None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:15.173983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 523/1026] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:19:15 2022] GET /identity/v3/endpoints?service_id=f6a397c0ef684151b683eaa3cb846dda&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:15.179716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:15.282210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156df0b5-6e41-4c54-a40b-3e711cc2879e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:15.315423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:15.316088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:15.316371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:15.316647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:15.317352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:15.319321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b5911-f47e-4473-855f-f88edd15244a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:15.333360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 504/1027] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:19:15 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:19:16.507305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7f1-e43a-4649-b533-8329d788b241 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:16.507830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7f1-e43a-4649-b533-8329d788b241 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:16.507830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6d7f1-e43a-4649-b533-8329d788b241 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:16.509395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 524/1028] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:16.514674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:16.515071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:16.515232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:16.542162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:16.543353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:16.601903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:16.612920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 505/1029] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:16.636839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6d7f1-e43a-4649-b533-8329d788b241 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:16.649803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:16.740116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6d7f1-e43a-4649-b533-8329d788b241 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:16.775106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:16.775830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:16.776110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:16.776382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:16.786213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:16.794916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:16.795897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:16.796756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:16.798190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 525/1030] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:19:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:16.801939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:16.903137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bf30a-67a5-4ef4-90cc-6f0dff845327 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:16.940200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:16.940886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:16.941163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:16.941482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:16.942247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:16.942548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:16.944622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158f59f-3b40-4f82-8def-d8702eefdcba None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:16.953654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 506/1031] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:19:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:16.960198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.030924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.062874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe7e4e-d1e7-4b40-be22-eafd4d12242f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.097083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.097901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.098185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.098456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.109349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.110809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.112358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80ef-3818-417a-8121-b7c0732a710b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.112582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80ef-3818-417a-8121-b7c0732a710b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.112863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312c80ef-3818-417a-8121-b7c0732a710b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.114397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 507/1032] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:17.119998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.120283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.120559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:17.128849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:17.129788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:17.131467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:17.131467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:17.131467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:17.131467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:17.133576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 526/1033] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:17.136403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.138197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:17.139380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:17.190366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.213335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 508/1034] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:17.234157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.247533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79795f8-cc9f-4f73-9c7e-0cd49822fed9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.273796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.286494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.287827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.288112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.288470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.289187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:17.289522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.290870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.308068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 527/1035] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:17.308794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.348586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c1981-f8b0-4904-8e2a-6558aa3f69f3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.384762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.385632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.385913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.386188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.387459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.388935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.390691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 509/1036] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:17.397472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.424813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27001bd-157e-4e9a-8e2e-0ea912d494bf None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.456198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.467578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947864cc-8e09-4111-b43e-037731396600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.472142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947864cc-8e09-4111-b43e-037731396600 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.472142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947864cc-8e09-4111-b43e-037731396600 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.472142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947864cc-8e09-4111-b43e-037731396600 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.476539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947864cc-8e09-4111-b43e-037731396600 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.478014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947864cc-8e09-4111-b43e-037731396600 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-947864cc-8e09-4111-b43e-037731396600 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:19:17.494339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:17.495348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:17.496488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:17.499244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 528/1037] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:17.500115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947864cc-8e09-4111-b43e-037731396600 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.511780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebac6fe-4a32-4580-8639-f73b192fa7fe None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.552288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.553676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.553854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.554090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.554765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.554869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.556585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf64d5-91ef-40af-8b47-5f644499965b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.611051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947864cc-8e09-4111-b43e-037731396600 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.645140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.645829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.646148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.646417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.648694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:17.648694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.649056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ea422-2281-49a3-9063-67f830f9deed None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.666024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 529/1038] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:17.667217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b32e-6cba-431e-b9b3-ae3e604ec1cb None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.667502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b32e-6cba-431e-b9b3-ae3e604ec1cb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.667778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34b32e-6cba-431e-b9b3-ae3e604ec1cb None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.668996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 530/1039] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:17.672562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34b32e-6cba-431e-b9b3-ae3e604ec1cb None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.683156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 510/1040] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:19:17 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:17.683156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.683156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.683156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.712745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:17.714293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:17.786014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.790891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34b32e-6cba-431e-b9b3-ae3e604ec1cb None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.801600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 511/1041] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:17.825477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:17.827298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.828164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.829579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.829864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.869883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:17.912157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.913804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.944692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74beaa0-90ff-4439-b756-424ddb63f656 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:17.984110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:17.984910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:17.985200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:17.985505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:17.986160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:17.987527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:17.999740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:18.000773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 03:19:18.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:18.003509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 512/1042] 10.222.0.71 () {56 vars in 1105 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:18.007634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.027931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.032154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 531/1043] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:17 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:19:18.039156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.119044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420dd46-d25f-4477-8e40-6bba31c9b9b2 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.120683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.148602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea506-4633-4ded-8845-b49aadaeb335 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.161492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.162993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.163283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.163561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.164741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] RBAC: Adding query filter params (name=image) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:18.165331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.166972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.179371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 513/1044] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:18.180425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.185466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.186265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.186554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.186881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.197903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.199344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:18.218503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:18.219515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:18.220445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:18.220445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:18.220445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:18.220445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:18.220445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 532/1045] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:18.224517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.282797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.293128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c707f-9c5c-4c60-bcff-edcfc52ebf0f None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.327911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.328578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.328862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.329139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.329878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] RBAC: Adding query filter params (type=image) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:18.330183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.331537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.334579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf05550-d6de-486a-ab3c-24d96129e2db None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.337188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 514/1046] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:18.342650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.372041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.372637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.372923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.373196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.373956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:18.374149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.374249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.375983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.388846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 533/1047] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:18.394144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.447804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300bd94-4e38-4ac0-9874-0af4e0a9421a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.486283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.487059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.487244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.487484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.488220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.489616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.500082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8895a-b5d7-425b-821d-50a9ed992449 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.514895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.537927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.538733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.539017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.539294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.546056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.547529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:18.561197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:18.562745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:18.564043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 534/1048] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:18.568409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.609289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 515/1049] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:19:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:18.694037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d4401-0c21-4153-9ef3-574221536ae2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.739259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.740502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.741026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.741447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.742302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:18.742622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.744082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7a8a1-9560-44a8-9360-60c627d2ccbc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.763737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 535/1050] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:18.765132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:18.856643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:18.872492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d62f31-38a7-4a2b-b20c-7d6a745de298 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:18.909488 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:18.910150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:18.910439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:18.910716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:18.912284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] RBAC: Adding query filter params (role.id=2a4773bb62a9434ba9e85c7f72a3d89f, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:18.912601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:18.914164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa75512-316e-43f4-829f-4ba058f541ff None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:18.921331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 516/1051] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:18 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=2a4773bb62a9434ba9e85c7f72a3d89f => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:19.992622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae30a2-e92b-44d8-ba9f-5b74ec8fe4ca None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:19.993251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae30a2-e92b-44d8-ba9f-5b74ec8fe4ca None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:19.993251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae30a2-e92b-44d8-ba9f-5b74ec8fe4ca None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:19.994856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 536/1052] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:19.999825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.000232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.000406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.018527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:20.019715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:20.090499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 517/1053] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:20.114193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae30a2-e92b-44d8-ba9f-5b74ec8fe4ca None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:20.142623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:20.219393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae30a2-e92b-44d8-ba9f-5b74ec8fe4ca None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:20.253535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:20.254250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.254529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.254799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.264799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:20.272977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:20.274055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:20.274993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:20.277615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 537/1054] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:20.280073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:20.367153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:20.387186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376388f8-c456-4b5e-bfcc-cbc133cb4c7c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:20.422638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:20.423330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.423616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.423892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.424661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:20.424988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:20.426401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:20.439571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 518/1055] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:20.441020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:20.547621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:20.559464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96b83-6696-4806-a795-f53115e68fca None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:20.598038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:20.599321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.599764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.600044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] PATH_INFO: `/v3/users/418e1e55492941a5868a220317e4457d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.614354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] RBAC: Authorizing `identity:get_user(user_id=418e1e55492941a5868a220317e4457d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:20.615973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693fc62-b8c9-432d-a744-dd7395c4bb7f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:20.623180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 538/1056] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:20 2022] GET /identity/v3/users/418e1e55492941a5868a220317e4457d => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:20.624215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:20.736649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db0f64-4992-4ea9-a2b4-c80eece3293e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:20.770787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:20.772186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.772463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.772736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.785613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:20.845673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:20.847403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:20.877448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9902d3-8ab5-4b0c-a602-05cefcd7b879 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.877739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9902d3-8ab5-4b0c-a602-05cefcd7b879 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.878022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9902d3-8ab5-4b0c-a602-05cefcd7b879 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.879394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 539/1057] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:20.884824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:20.885108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:20.885419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:20.903402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:20.904594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:20.973330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 519/1058] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:20.976133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:20.980093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 540/1059] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:19:21.002214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.019674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.084314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ceb22e-ecca-4f26-8588-c68fdb100b01 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.087374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.114725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43e5d1-ac19-497a-90e2-f149efcedfee None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.123612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.125192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.125724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.126149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.127692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.129333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559670ec-5bd3-460d-b3ca-64ce37cd015b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.132058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 520/1060] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:20 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:21.135329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396d2d-ca58-4b3b-818f-78ebbe84b87b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.135692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396d2d-ca58-4b3b-818f-78ebbe84b87b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.135874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5396d2d-ca58-4b3b-818f-78ebbe84b87b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.137426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 521/1061] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:21.138127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396d2d-ca58-4b3b-818f-78ebbe84b87b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.158883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.159535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.159819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.160096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.232241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.234297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.254185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5396d2d-ca58-4b3b-818f-78ebbe84b87b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.267266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.295162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.295821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.296105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.296390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.297215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=6ea10dd6485648039287aa7754c87c44, user.id=418e1e55492941a5868a220317e4457d) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:21.297634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.299641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b453-a03b-4d7f-ba88-23a9b652fd8c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.307014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 522/1062] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/role_assignments?user.id=418e1e55492941a5868a220317e4457d&scope.project.id=6ea10dd6485648039287aa7754c87c44&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:21.308669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.309184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.309640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.317585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.331939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:21.333658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:21.350199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 541/1063] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:19:21.352350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.418221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 523/1064] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:21.441295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.473199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e86c-d548-4e40-a722-0b039852a644 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.519467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.519467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.519467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.519467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.529852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.531310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:21.550486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:21.551541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:21.552942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:21.552942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:21.552942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:21.552942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:21.557399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 542/1065] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:21.558083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.567115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbf68f9-7ec4-469f-9279-59526945ae1e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.571471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.587542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.605287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.606028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.606318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.606764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.620891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:21.629157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:21.630174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:21.632495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:21.633395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 524/1066] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:21.636948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.668221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3a11f-0fa5-4619-a189-562a08059e4a None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.705499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.706170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.706455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.706727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.707444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:21.708069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.709646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.721760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 543/1067] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:21.751537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42d869-bfbe-41c0-8727-6c62df8ecd17 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.792282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.792972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.793274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.793569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.794338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:21.794646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.797397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:21.811172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 525/1068] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:21.812948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:21.914591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:21.927852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816f3dd-eb79-4c9c-8c19-89f2958b0df7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:21.965244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:21.966066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:21.966350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:21.966621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:21.977996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:21.979474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:22.000350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:22.001499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:22.002974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:22.002974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:22.002974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:22.002974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:22.002974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 544/1069] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:22.007839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.039253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:22.116001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88decfd8-7627-4f8c-bf04-1fa98e952996 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.150498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.151154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.151438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.151714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.152431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:22.152737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.154130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.166569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 526/1070] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:22.172051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.272021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d384e0-acb1-4ad5-b8a9-ac72e5d042d3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.305098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.305911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.306201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.306483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.313341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.314757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.317210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:19:22.329995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:22.337233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:22.338396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 545/1071] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:22.339040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.421625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:22.437734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5be8a-c9ca-4180-8812-d5e04930ab94 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.471468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.472320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.472781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.473463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.474333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:22.474646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.476082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.493862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 527/1072] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:22.499691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.602353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0d745-5c1c-4bdb-9657-1158f3d23bbc None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.635608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.636393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.636676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.636949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.647502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.648931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:22.666161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:22.667127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:22.668071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:22.668071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:22.668071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:22.668071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:22.669425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 546/1073] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:22.673104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.772323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88d562-c739-4238-902f-e3235e134a0b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.805040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.805758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.806067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.806359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.807064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:22.807372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.808750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.820500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 528/1074] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:22.826109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.879242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:22.925130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab05500-0faf-4ba3-a700-318e1ff6e000 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:22.959313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:22.960098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:22.960381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:22.960655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:22.967198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:22.968651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:22.983306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:22.984398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:22.990525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 547/1075] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:22.991059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:22.995045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:23.089994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05a693-4855-4726-a22b-f46a5611457e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:23.122705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:23.123358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.123666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.123939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.124716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:23.125022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:23.126497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9228d-c5de-4eb0-9a32-e4cc144c1a31 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:23.138308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 529/1076] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:23.144127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:23.243692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0c66-d488-4ca8-b592-089b47cd9d90 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:23.257780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:23.278363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:23.279296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.279671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.279946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/2a4773bb62a9434ba9e85c7f72a3d89f` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.282123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=17726b67d4d54d38be845acf03cbb664, role_id=2a4773bb62a9434ba9e85c7f72a3d89f)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:23.283539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb34ea-de70-4d15-8e26-a81bd6012235 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:23.387671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 548/1077] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:19:23 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/17726b67d4d54d38be845acf03cbb664/roles/2a4773bb62a9434ba9e85c7f72a3d89f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:23.520672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f49c13-845a-413f-9008-1c79e9887db1 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.520980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f49c13-845a-413f-9008-1c79e9887db1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.521744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f49c13-845a-413f-9008-1c79e9887db1 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.523183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 530/1078] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:23.529027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.529354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.529636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.548324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:23.549579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:23.621512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 549/1079] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:23.643577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f49c13-845a-413f-9008-1c79e9887db1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:23.706318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:23.746221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f49c13-845a-413f-9008-1c79e9887db1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:23.779447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:23.780159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.780443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.780715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.790688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:23.798465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:23.799578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:23.800623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 531/1080] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:23.808037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:23.904494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b797c3b-a678-4040-bf37-846626176d3e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:23.906082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:23.937962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:23.938718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:23.939002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:23.939279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:23.940016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:23.940323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:23.941727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:23.950911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 550/1081] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:23.956571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:24.054913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305adef-db9f-4102-b1fd-b30f63b8336e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:24.077923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:24.088651 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:24.092722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:24.092722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:24.092722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] PATH_INFO: `/v3/users/418e1e55492941a5868a220317e4457d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:24.092722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] RBAC: Authorizing `identity:get_user(user_id=418e1e55492941a5868a220317e4457d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:24.092722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:24.094379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 532/1082] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:23 2022] GET /identity/v3/users/418e1e55492941a5868a220317e4457d => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:24.100919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:24.199332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13099c46-30ae-42bc-b061-adfb24b3d881 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:24.232550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:24.233430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:24.233715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:24.233987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:24.235144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:24.236560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe7758-9f83-4c2d-80bd-4c08e9595f93 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:24.238282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 551/1083] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:24 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:24.244677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:24.344380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe07a-b62c-4d7a-ab6d-274eea8c059b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:24.377216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:24.378240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:24.378527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:24.378801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44/users/418e1e55492941a5868a220317e4457d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:24.381557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ea10dd6485648039287aa7754c87c44, user_id=418e1e55492941a5868a220317e4457d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:24.383000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1849cee2-4ed1-42af-b7aa-15c028793fd0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:24.461856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 533/1084] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:19:24 2022] PUT /identity/v3/projects/6ea10dd6485648039287aa7754c87c44/users/418e1e55492941a5868a220317e4457d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:25.609716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256032-0c4d-454e-a138-4c80c04ee5b5 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:25.610230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256032-0c4d-454e-a138-4c80c04ee5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:25.610321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4256032-0c4d-454e-a138-4c80c04ee5b5 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:25.611650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 552/1085] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:25.617899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:25.618360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:25.618454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:25.636025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:25.637220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:25.684707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:25.704985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 534/1086] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:25.728795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4256032-0c4d-454e-a138-4c80c04ee5b5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:25.760479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:25.831842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4256032-0c4d-454e-a138-4c80c04ee5b5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:25.866275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:25.867198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:25.867590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:25.867967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:25.880542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:25.889058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:25.890048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:25.890912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 553/1087] 10.222.0.71 () {56 vars in 1120 bytes} [Fri May 27 03:19:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:25.896370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:25.992722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08ee9-d566-4203-9632-e87de1f836f7 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.026254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.026911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.027191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.027465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.028203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:26.028506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:26.029910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:26.038377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 535/1088] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:19:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:26.043941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.132633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.141146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d59df4-43a0-4bc0-acb6-abc80eeb2d11 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.177089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.177908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.178187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.178458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.189624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:26.191327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:26.210277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:26.211451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:26.212375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:26.212375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:26.212375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:26.212375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:26.212375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 554/1089] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:26.217239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.262605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.316131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c82f7-9d71-4689-b0f7-658d79aa9672 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.349895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.350550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.350834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.351108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.351825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:26.352129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:26.353508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:26.365311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 536/1090] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:26.371498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.472445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b827bb-a28c-4e7f-89c6-66a626070513 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.508155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.508947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.509229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.509534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.516515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:26.517997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-8600f9e3-7473-46ee-b33e-da51a45d41d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:19:26.534921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:26.535874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:26.542110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 555/1091] 10.222.0.71 () {56 vars in 1093 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:26.544188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.645166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2914c6-291d-4a17-b9a1-fa63f617fe67 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.646295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2914c6-291d-4a17-b9a1-fa63f617fe67 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.646475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2914c6-291d-4a17-b9a1-fa63f617fe67 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.647932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 556/1092] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:19:26.649588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231d97-34a8-450f-8827-dcd3af9b6cef None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.652709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.653107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.653429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.653706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.659630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.750417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:26.751542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:26.773551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.774228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.774515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.774794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.775624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:26.775934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:26.777433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:26.794842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 537/1093] 10.222.0.71 () {56 vars in 1133 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:26.800195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.820815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 557/1094] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:26.846494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:26.900639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fe452f-9ae8-4c0a-a4f5-973eeaa84e62 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.934184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.934832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.935118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.935391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.944574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3851ab8-f7e5-45b0-b46b-a63775c769ab None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:26.964913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.977496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:26.979094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:26.979094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:26.979094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:26.980816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:26.990161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:26.997960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:26.998999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:26.999871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 558/1095] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:27.007853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.007853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.008055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.103515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c654b0c-54a1-4a4b-a62a-65503c97998f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.104650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 538/1096] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:19:27.110564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.137232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.138024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.138374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.138660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.139405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:27.139715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.141087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.150317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 559/1097] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:27.156029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.170700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.210030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf5c27-8214-4d58-9583-7b38f320c898 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.212304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.243989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.244773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.245051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.245353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.255478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b364a53-0de6-4d5d-ad11-99c2e35e46ad None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.256479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.258039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:27.275144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:27.276051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:27.276947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:19:27.276947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:27.276947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:19:27.276947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:27.276947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 539/1098] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:27.281940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.290062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.290942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.291226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.291504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] PATH_INFO: `/v3/users/418e1e55492941a5868a220317e4457d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.292699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] RBAC: Authorizing `identity:get_user(user_id=418e1e55492941a5868a220317e4457d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.294179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.300334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 560/1099] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/users/418e1e55492941a5868a220317e4457d => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:27.301220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.380644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9216097-3120-4536-bc00-1241906497a9 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.394076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.401333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cc7b0-55cd-41bf-b507-7f86127c91d0 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.414338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.414999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.415283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.415571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.416278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:27.416585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.417980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.424652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.430254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 540/1100] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:27.435722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.436014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.436673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.436964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.437239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.504669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.506590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.542025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435adf-fb78-46f6-b735-4d2e317ebb44 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.576391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.577197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.579107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.579107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.585099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.586611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:19:27.601433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:27.602555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:27.603578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 541/1101] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:27.608417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.614582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 561/1102] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:19:27.620235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.644177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.644333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.710189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29c79a-9410-4351-b179-6b69916cd313 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.717606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88f99-f01f-4b45-9e27-3d9003bae715 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.745543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.746194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.746480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.746747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.747528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:27.747834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.749284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.751391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.752248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.752531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.752812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.754019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.755577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.757278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 562/1103] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:27.760670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 542/1104] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:27.766307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.766689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:27.858631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.860568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:27.867200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ce211-33f0-4f70-bc6e-e5d7d9d4034b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.871190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05be12e-40ef-4b9c-9e24-f490b48d3792 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:27.900753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.901430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.917457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:27.917667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.917667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.917841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:27.917841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:27.917994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=6ea10dd6485648039287aa7754c87c44, user.id=418e1e55492941a5868a220317e4457d) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:27.918088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:27.918171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.918252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] RBAC: Adding query filter params (role.id=2a4773bb62a9434ba9e85c7f72a3d89f, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=17726b67d4d54d38be845acf03cbb664) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:27.918252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:27.918415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6dc95-136f-471c-a50f-836113719a7f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.918505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542ddb7-7242-4908-821e-dceeaf7dbf2f None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:27.918595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 563/1105] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/role_assignments?user.id=418e1e55492941a5868a220317e4457d&scope.project.id=6ea10dd6485648039287aa7754c87c44&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:27.918686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 543/1106] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:27 2022] GET /identity/v3/role_assignments?user.id=17726b67d4d54d38be845acf03cbb664&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=2a4773bb62a9434ba9e85c7f72a3d89f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:30.141924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f49b2-d4f3-435e-8c6c-8af4a84267f8 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:30.142565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f49b2-d4f3-435e-8c6c-8af4a84267f8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:30.142565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f49b2-d4f3-435e-8c6c-8af4a84267f8 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:30.143852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 564/1107] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:30.149789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:30.150206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:30.150348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:30.167307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:30.168471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:30.234001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 544/1108] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:30.259860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f49b2-d4f3-435e-8c6c-8af4a84267f8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:30.359511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f49b2-d4f3-435e-8c6c-8af4a84267f8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:30.393108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:30.393861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:30.394146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:30.394444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:30.396265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:30.397735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5ad55-6a99-4e64-9115-b6021806ec4f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:30.399322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 565/1109] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:30.404976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:30.488752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:30.500798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8326f7-b78a-4694-9f27-a49c3d5bdb23 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:30.534492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:30.535171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:30.535454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:30.535732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:30.536546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:30.538127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d949228-47cb-47ed-9f80-54e8d7b5c060 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:30.636837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 545/1110] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:19:30 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:32.907776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04ad-de60-459f-86e2-93c299a0c863 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:32.908290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04ad-de60-459f-86e2-93c299a0c863 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:32.908382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac04ad-de60-459f-86e2-93c299a0c863 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:32.909752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 566/1111] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:32.916028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:32.916426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:32.916591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:32.933310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:32.934497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:33.000093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 546/1112] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:33.024662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac04ad-de60-459f-86e2-93c299a0c863 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:33.049716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:33.123411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac04ad-de60-459f-86e2-93c299a0c863 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:33.156691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:33.157552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:33.157883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:33.158108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] PATH_INFO: `/v3/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:33.159562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] RBAC: Authorizing `identity:get_role(role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:33.160956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:33.162331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 567/1113] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:33 2022] GET /identity/v3/roles/5daf32e946ee47d98d2041330c41a624 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:33.168006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:33.242053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:33.266028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa518e-c78d-4cb6-8600-5b69a9eac733 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:33.298623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:33.299483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:33.299763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:33.300034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] PATH_INFO: `/v3/users/2dd8d149230744319630453eea3077c7` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:33.314366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] RBAC: Authorizing `identity:get_user(user_id=2dd8d149230744319630453eea3077c7)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:33.315811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:33.318154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 547/1114] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:33 2022] GET /identity/v3/users/2dd8d149230744319630453eea3077c7 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:33.323999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:33.411982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:33.420155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12f434-bbc5-4074-9f4c-2c472a596ce3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:33.452934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:33.453635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:33.454121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:33.454450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:33.521317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:33.522765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:33.609611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:33.619568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 568/1115] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:33.626437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:33.724968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2acb1f-38f6-4588-b2c4-75e0ea8a793d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:33.753737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:33.759330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58e8a1c-6671-4df3-9047-559ad17be78e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:33.777883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 548/1116] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:33 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:33.778389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:33.868895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae39cb-a3f7-435e-9275-b3584efdc0ac None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:33.901486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:33.902136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:33.902421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:33.902700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:33.903513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=6ea10dd6485648039287aa7754c87c44, user.id=2dd8d149230744319630453eea3077c7) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:33.903828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:33.905246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57ed20-7930-485b-8baa-c2110459e1d0 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:33.910566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 569/1117] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:33 2022] GET /identity/v3/role_assignments?user.id=2dd8d149230744319630453eea3077c7&scope.project.id=6ea10dd6485648039287aa7754c87c44&role.id=5daf32e946ee47d98d2041330c41a624 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:36.075352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebdc8-999a-46e0-bce8-3260b7ce036f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.075893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebdc8-999a-46e0-bce8-3260b7ce036f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.075893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ebdc8-999a-46e0-bce8-3260b7ce036f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.077247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 549/1118] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:36.083547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.084026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.084310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.101234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:36.102433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:36.150144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:36.165732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 570/1119] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:36.188037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebdc8-999a-46e0-bce8-3260b7ce036f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:36.285848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ebdc8-999a-46e0-bce8-3260b7ce036f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:36.317926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:36.318758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.319037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.319307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] PATH_INFO: `/v3/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.320747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] RBAC: Authorizing `identity:get_role(role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:36.322121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:36.323449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 550/1120] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:36 2022] GET /identity/v3/roles/5daf32e946ee47d98d2041330c41a624 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:36.329179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:36.425978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481ec66-a1b3-49c4-bff3-9b64836c04fe None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:36.460230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:36.461081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.461394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.461675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] PATH_INFO: `/v3/users/2dd8d149230744319630453eea3077c7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.462863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] RBAC: Authorizing `identity:get_user(user_id=2dd8d149230744319630453eea3077c7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:36.464347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:36.466027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 571/1121] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:36 2022] GET /identity/v3/users/2dd8d149230744319630453eea3077c7 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:36.471903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:36.538154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:36.570565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2094ef-2b51-4458-85ac-7351ae00cf86 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:36.605251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:36.606075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.606359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.606636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.607795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:36.609214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443fe130-bfe1-4ef2-8305-1dd62e09d4ee None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:36.610916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 551/1122] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:36 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:36.617035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:36.670823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:36.714567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee57038-9b41-493b-8130-b3d7d6c1ba8e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:36.746545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:36.747412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:36.747692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:36.747995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44/users/2dd8d149230744319630453eea3077c7/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:36.750164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] RBAC: Authorizing `identity:create_grant(project_id=6ea10dd6485648039287aa7754c87c44, user_id=2dd8d149230744319630453eea3077c7, role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:36.751577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b22b2a-e9e2-4a9e-94da-c6ae60418d35 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:36.846842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 572/1123] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:19:36 2022] PUT /identity/v3/projects/6ea10dd6485648039287aa7754c87c44/users/2dd8d149230744319630453eea3077c7/roles/5daf32e946ee47d98d2041330c41a624 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:39.045902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08cf5-6ad1-4081-a0e2-fe7eb277bf0a None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.046460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08cf5-6ad1-4081-a0e2-fe7eb277bf0a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.046460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a08cf5-6ad1-4081-a0e2-fe7eb277bf0a None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.047813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 552/1124] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:39.053713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.054085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.054270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.071282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:39.072474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:39.137645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 573/1125] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:39.161578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08cf5-6ad1-4081-a0e2-fe7eb277bf0a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:39.261987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a08cf5-6ad1-4081-a0e2-fe7eb277bf0a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:39.295099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:39.296010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.296244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.296521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] PATH_INFO: `/v3/roles/5daf32e946ee47d98d2041330c41a624` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.298014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] RBAC: Authorizing `identity:get_role(role_id=5daf32e946ee47d98d2041330c41a624)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:39.299385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:39.300741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 553/1126] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:39 2022] GET /identity/v3/roles/5daf32e946ee47d98d2041330c41a624 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:39.307322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:39.350822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:39.403188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e076716-a31d-45e4-b2a7-0aeeaa5d56ae None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:39.437139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:39.438027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.438308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.438579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] PATH_INFO: `/v3/users/2dd8d149230744319630453eea3077c7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.439750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] RBAC: Authorizing `identity:get_user(user_id=2dd8d149230744319630453eea3077c7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:39.441170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:39.442837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 574/1127] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:39 2022] GET /identity/v3/users/2dd8d149230744319630453eea3077c7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:39.448679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:39.452447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:39.548123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82859a-2ed6-4640-83cf-8bec5a0f3a28 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:39.580624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:39.581279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.581580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.581861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.648457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:39.649951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:39.652456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:39.746128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 554/1128] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:39.751954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:39.847538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195149af-9a79-4997-b574-2ade65f3231e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:39.860194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:39.880240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:39.881097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:39.881404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:39.881676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] PATH_INFO: `/v3/projects/6ea10dd6485648039287aa7754c87c44` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:39.882829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] RBAC: Authorizing `identity:get_project(project_id=6ea10dd6485648039287aa7754c87c44)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:39.884325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf413f1-4c09-4391-b1f6-4ddb0cd807b7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:39.886004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 575/1129] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:39 2022] GET /identity/v3/projects/6ea10dd6485648039287aa7754c87c44 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:39.892178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:39.987142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2af56-02af-4e6f-bab5-983c38777873 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:39.989491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:40.020542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:40.021181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:40.021580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:40.021769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:40.022585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] RBAC: Adding query filter params (role.id=5daf32e946ee47d98d2041330c41a624, scope.project.id=6ea10dd6485648039287aa7754c87c44, user.id=2dd8d149230744319630453eea3077c7) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:40.022889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:40.024313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450c7d1-0727-4429-a7e7-f79aef017bcb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:40.029945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 555/1130] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:39 2022] GET /identity/v3/role_assignments?user.id=2dd8d149230744319630453eea3077c7&scope.project.id=6ea10dd6485648039287aa7754c87c44&role.id=5daf32e946ee47d98d2041330c41a624 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:42.252480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6fcb-f89f-44a9-99ae-0e3ecc9aaaec None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:42.253043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6fcb-f89f-44a9-99ae-0e3ecc9aaaec None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:42.253043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6fcb-f89f-44a9-99ae-0e3ecc9aaaec None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:42.255072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 576/1131] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:42.260315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:42.260734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:42.260872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:42.277914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:42.279096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:42.343428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 556/1132] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:42.367643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6fcb-f89f-44a9-99ae-0e3ecc9aaaec None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:42.467450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6fcb-f89f-44a9-99ae-0e3ecc9aaaec None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:42.501378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:42.502158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:42.502442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:42.502769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:42.503876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:42.506317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac304dfb-1de8-4f7a-98a5-237625afb5e4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:42.507914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 577/1133] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:42.513810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:42.606498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:42.610448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff26d61-f241-4130-a3e7-98f93c1dbc10 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:42.643427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:42.644067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:42.644351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:42.644740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:42.645586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:42.647012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac82df1d-5676-470d-98a6-d8a0bb8812a5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:42.786273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 557/1134] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:19:42 2022] POST /identity/v3/projects => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:19:45.044315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528928-98ea-48c6-b20a-6a1c9f5e9265 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:45.044844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528928-98ea-48c6-b20a-6a1c9f5e9265 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:45.044844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf528928-98ea-48c6-b20a-6a1c9f5e9265 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:45.046286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 578/1135] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:45.052181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:45.052904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:45.053182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:45.070047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:45.071229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:45.135499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 558/1136] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:45.160496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528928-98ea-48c6-b20a-6a1c9f5e9265 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:45.210498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:45.260838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf528928-98ea-48c6-b20a-6a1c9f5e9265 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:45.293717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:45.294549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:45.294778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:45.295051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:45.296215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:45.297657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9c5f6a-f108-4f7d-ab7a-84afea91ba88 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:45.299281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 579/1137] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:19:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:45.306088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:45.384713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:45.403027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92524702-f7f4-48b5-ad20-2b4543633ec3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:45.437877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:45.438536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:45.438814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:45.439084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:45.439780 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:45.441225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15776d3-e684-46c7-862e-212dd3cfe9b2 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:45.546375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 559/1138] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:19:45 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:19:47.811160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c1b1-3a00-4068-8ff1-a5ec72c1c71e None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:47.811665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c1b1-3a00-4068-8ff1-a5ec72c1c71e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:47.811665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa4c1b1-3a00-4068-8ff1-a5ec72c1c71e None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:47.813021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 580/1139] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:47.818439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:47.818890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:47.818997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:47.836835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:47.838019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:47.901497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 560/1140] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:47.925116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4c1b1-3a00-4068-8ff1-a5ec72c1c71e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.024149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa4c1b1-3a00-4068-8ff1-a5ec72c1c71e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.040446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:48.057684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.058520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.058802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.059079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.069062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:48.077491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:48.078591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:48.079628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 581/1141] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:48.085517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.148520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:48.180696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7866395-0ddd-42b2-9ae1-d4f173114f42 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.214636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.215289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.215569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.215841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.216576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:48.216879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:48.218260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:48.226398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 561/1142] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:48.231930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.333023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67f6e51-d8d6-44c6-bc93-603d448a5d05 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.365480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.366345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.366629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.366904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] PATH_INFO: `/v3/users/ce1b09611a60467da338f4658f4c80ea` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.380319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ce1b09611a60467da338f4658f4c80ea)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:48.381791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:48.383420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 582/1143] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:48 2022] GET /identity/v3/users/ce1b09611a60467da338f4658f4c80ea => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:48.389178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.488920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf7041-1fc1-4c78-954e-d3f67458eb94 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.514821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:48.522677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.523329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.523614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.523893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.590891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:48.592255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:48.685580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 562/1144] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:48.692030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.724831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:48.789459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a13bff7-1ee8-464f-aee4-f5ce9ade39c9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.823203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.824053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.824334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.824608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] PATH_INFO: `/v3/projects/d45bbc9855e343c4b873005b41da2477` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.825795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] RBAC: Authorizing `identity:get_project(project_id=d45bbc9855e343c4b873005b41da2477)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:48.827248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492909f4-fdee-444a-b37b-28f053a9aacf None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:48.828917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 583/1145] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:48 2022] GET /identity/v3/projects/d45bbc9855e343c4b873005b41da2477 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:48.835241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:48.861909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:48.936395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0f9580-4945-4999-8935-71ae3806dac5 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:48.968522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:48.969151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:48.969458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:48.969729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:48.970538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=d45bbc9855e343c4b873005b41da2477, user.id=ce1b09611a60467da338f4658f4c80ea) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:48.970843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:48.972249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac4247-901c-4bc1-924c-e0a347a7f9e3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:48.978083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 563/1146] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:48 2022] GET /identity/v3/role_assignments?user.id=ce1b09611a60467da338f4658f4c80ea&scope.project.id=d45bbc9855e343c4b873005b41da2477&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:51.140990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f6a0-112b-438f-8640-f97324f56103 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.141601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f6a0-112b-438f-8640-f97324f56103 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.141601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883f6a0-112b-438f-8640-f97324f56103 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.142957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 584/1147] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:51.148759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.149197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.149349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.165699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:51.166852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:51.232399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 564/1148] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:51.255373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f6a0-112b-438f-8640-f97324f56103 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:51.354571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883f6a0-112b-438f-8640-f97324f56103 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:51.356039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:51.387967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:51.388741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.389023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.389321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.404635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:51.412278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:51.413531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:51.414678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 585/1149] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:19:51.419663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:51.443103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:51.515958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe24d1-33cd-48cc-9b43-1defc6677350 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:51.549627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:51.550287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.550661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.550940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.551668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:51.551972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:51.553373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:51.561161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 565/1150] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:51.567116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:51.666818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799774a6-02a2-4e6a-845a-e5d762033f49 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:51.699046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:51.699908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.700193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.700472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] PATH_INFO: `/v3/users/ce1b09611a60467da338f4658f4c80ea` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.701661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] RBAC: Authorizing `identity:get_user(user_id=ce1b09611a60467da338f4658f4c80ea)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:51.703101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:51.704712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 586/1151] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:51 2022] GET /identity/v3/users/ce1b09611a60467da338f4658f4c80ea => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:51.711250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:51.796069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:51.811781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184d38a-d4b2-4068-b4f9-e34572ca46dd None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:51.845770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:51.846620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.846897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.847185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] PATH_INFO: `/v3/projects/d45bbc9855e343c4b873005b41da2477` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.849084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d45bbc9855e343c4b873005b41da2477)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:51.850543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4457ac-6a4c-45cc-9c84-71717f1344e5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:51.852226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 566/1152] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:51 2022] GET /identity/v3/projects/d45bbc9855e343c4b873005b41da2477 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:51.858113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:51.888403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:51.955095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271deba8-7335-4bb5-b90e-e13e6c95bf8c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:51.987699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:51.988773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:51.989049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:51.989350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] PATH_INFO: `/v3/projects/d45bbc9855e343c4b873005b41da2477/users/ce1b09611a60467da338f4658f4c80ea/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:51.991262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=d45bbc9855e343c4b873005b41da2477, user_id=ce1b09611a60467da338f4658f4c80ea, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:51.992676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c112247-1f8b-4002-a638-8170890d47e2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:52.070085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 587/1153] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:19:51 2022] PUT /identity/v3/projects/d45bbc9855e343c4b873005b41da2477/users/ce1b09611a60467da338f4658f4c80ea/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:19:54.275487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b100-7ec8-4a11-b2fd-194404ecfb01 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.276015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b100-7ec8-4a11-b2fd-194404ecfb01 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.276015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0b100-7ec8-4a11-b2fd-194404ecfb01 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.277436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 567/1154] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:54.282620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.283013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.283179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.299352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:54.300570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:54.364306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 588/1155] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:54.388574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b100-7ec8-4a11-b2fd-194404ecfb01 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.487529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e0b100-7ec8-4a11-b2fd-194404ecfb01 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.521615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.522404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.522751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.522965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.533114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:19:54.541773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:54.542880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:19:54.543768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 568/1156] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:54.548883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.571590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:54.649693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9fdd7-a682-4741-8c57-3071e08711da None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.682526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.683183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.683464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.683736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.684465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:54.684768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.686143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.693879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 589/1157] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:19:54.699711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.715804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:54.798653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da07307-c50f-4b59-b472-7da7a5cc164b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.831292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] PATH_INFO: `/v3/users/ce1b09611a60467da338f4658f4c80ea` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] RBAC: Authorizing `identity:get_user(user_id=ce1b09611a60467da338f4658f4c80ea)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:54.843273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 569/1158] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/users/ce1b09611a60467da338f4658f4c80ea => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:54.843776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:54.922413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:54.939659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1b7c6-da23-4a8f-b3b8-cdfda601b042 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:54.974384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:54.975012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:54.975290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:54.975559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:55.039510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:55.040931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:55.116694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:55.134553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 590/1159] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:55.140415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:55.218951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:55.238392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7cb7a-b380-4874-a571-356a0ea2b8a3 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:55.272533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:55.273414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:55.273701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:55.273978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] PATH_INFO: `/v3/projects/d45bbc9855e343c4b873005b41da2477` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:55.275163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] RBAC: Authorizing `identity:get_project(project_id=d45bbc9855e343c4b873005b41da2477)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:55.276600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d143a-8612-422a-8b01-2972a1e14e36 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:55.278345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 570/1160] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:19:55 2022] GET /identity/v3/projects/d45bbc9855e343c4b873005b41da2477 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:55.284331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:55.380508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f86873-abca-4b88-82c6-aa35f5714243 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:55.412297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:55.412929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:55.413208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:55.413508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:55.414316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=d45bbc9855e343c4b873005b41da2477, user.id=ce1b09611a60467da338f4658f4c80ea) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:55.414621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:55.416017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11574417-68e1-4d9e-9d46-73591fa16dd2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:55.421645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 591/1161] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:19:55 2022] GET /identity/v3/role_assignments?user.id=ce1b09611a60467da338f4658f4c80ea&scope.project.id=d45bbc9855e343c4b873005b41da2477&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:19:57.612416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf177-f0c8-489d-a820-d072191ab9b8 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:57.613566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf177-f0c8-489d-a820-d072191ab9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:57.613566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bf177-f0c8-489d-a820-d072191ab9b8 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:57.614888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 571/1162] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:19:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:19:57.620146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:57.620542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:57.620697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:57.637551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:19:57.638709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:19:57.679767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:57.706308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 592/1163] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:19:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:19:57.727965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf177-f0c8-489d-a820-d072191ab9b8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:57.828917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bf177-f0c8-489d-a820-d072191ab9b8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:57.861845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:57.862478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:57.863414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:57.863705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:57.880643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:57.930114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:57.931545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:58.027542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 572/1164] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:19:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:19:58.033485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:58.129486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191bed-7051-4c74-8127-6c7f35b679c4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:58.162251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:58.163036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:58.163316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:58.163589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:58.170016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:58.171450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-bf84f125-8710-4a7f-9205-f8886640d6a1 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:19:58.185198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:19:58.186483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:19:58.187554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 593/1165] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:19:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:19:58.192881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:19:58.240276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:19:58.290408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a1ce8-9c22-4672-9295-255d97122f47 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:19:58.323934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:19:58.324584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:19:58.324871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:19:58.325149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:19:58.325901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:19:58.326209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:19:58.327600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b991c916-2ee9-4518-be52-bba9b334b2c7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:19:58.335247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 573/1166] 10.222.0.71 () {56 vars in 1115 bytes} [Fri May 27 03:19:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:20:00.530575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8df2-a26a-4019-810e-9772b8cf4bda None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:00.530987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8df2-a26a-4019-810e-9772b8cf4bda None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:00.531133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d8df2-a26a-4019-810e-9772b8cf4bda None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:00.532503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 594/1167] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:00.538608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a244e-d939-47b9-ba33-a9c9f09e5e09 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:00.539046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a244e-d939-47b9-ba33-a9c9f09e5e09 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:00.539174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a244e-d939-47b9-ba33-a9c9f09e5e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:00.555849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-428a244e-d939-47b9-ba33-a9c9f09e5e09 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:00.557020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-428a244e-d939-47b9-ba33-a9c9f09e5e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:00.623497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 574/1168] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:00.646792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8df2-a26a-4019-810e-9772b8cf4bda None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:00.683305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:00.749028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d8df2-a26a-4019-810e-9772b8cf4bda None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:00.782910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:00.783503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:00.783788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:00.784067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:00.785521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:00.786887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc076-faa0-4b73-868d-4872bb56523a None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:00.872064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 595/1169] 10.222.0.71 () {60 vars in 1138 bytes} [Fri May 27 03:20:00 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:20:03.062551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6735e-7980-41e8-99c2-0e85a73a63c9 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:03.063143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6735e-7980-41e8-99c2-0e85a73a63c9 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:03.063143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6735e-7980-41e8-99c2-0e85a73a63c9 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:03.064489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 575/1170] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:03.069878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:03.070322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:03.070429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:03.087637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:03.088815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:03.153707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 596/1171] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:03.176952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6735e-7980-41e8-99c2-0e85a73a63c9 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:03.221600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:03.277599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6735e-7980-41e8-99c2-0e85a73a63c9 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:03.309659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:03.310506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:03.310790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:03.311065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] PATH_INFO: `/v3/domains/8fb2461c9c4c4a2b853b0b085cff9ecc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:03.321799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fb2461c9c4c4a2b853b0b085cff9ecc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:03.323187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e422a-e607-42fb-9f3c-2f97e9f2420c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:03.324805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 576/1172] 10.222.0.71 () {56 vars in 1183 bytes} [Fri May 27 03:20:03 2022] GET /identity/v3/domains/8fb2461c9c4c4a2b853b0b085cff9ecc => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:03.330612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:03.357969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:03.428202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301d3ba-c2a9-42e9-88b1-942ecd3f07bb None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:03.461137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:03.461816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:03.462101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:03.462377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:03.463072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:03.464485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46830ceb-6201-42b5-9748-f183a312da83 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:03.546296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 597/1173] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:20:03 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:20:05.755172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af012a4-53f8-4db0-a66c-ab6b38367ddb None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:05.755694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af012a4-53f8-4db0-a66c-ab6b38367ddb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:05.755806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af012a4-53f8-4db0-a66c-ab6b38367ddb None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:05.757097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 577/1174] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:05.762403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:05.762839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:05.762961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:05.779753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:05.780857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:05.845581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 598/1175] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:05.870508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af012a4-53f8-4db0-a66c-ab6b38367ddb None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:05.970105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af012a4-53f8-4db0-a66c-ab6b38367ddb None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:05.971586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:06.003400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:06.004375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:06.004656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:06.004932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] PATH_INFO: `/v3/domains/8fb2461c9c4c4a2b853b0b085cff9ecc` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:06.006182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8fb2461c9c4c4a2b853b0b085cff9ecc)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:06.007620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1218af-5346-4365-9dc4-2d0d3bad0701 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:06.009208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 578/1176] 10.222.0.71 () {56 vars in 1183 bytes} [Fri May 27 03:20:05 2022] GET /identity/v3/domains/8fb2461c9c4c4a2b853b0b085cff9ecc => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:06.014938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:06.025418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:06.113042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe8424-3f73-4b96-a59a-30d9638f3a89 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:06.147127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:06.147789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:06.148074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:06.148351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:06.149082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:06.150527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834149b-08fc-46cf-92d8-450bc1d6ad20 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:06.242377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 599/1177] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:20:06 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:20:08.496151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bc51-eecd-45f3-8d89-0cdb7f166b1f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:08.496719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bc51-eecd-45f3-8d89-0cdb7f166b1f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:08.496719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616bc51-eecd-45f3-8d89-0cdb7f166b1f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:08.498115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 579/1178] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:08.503521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:08.503958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:08.504086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:08.520396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:08.521618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:08.578838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:08.587542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 600/1179] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:08.611247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616bc51-eecd-45f3-8d89-0cdb7f166b1f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:08.711397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616bc51-eecd-45f3-8d89-0cdb7f166b1f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:08.744006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:08.744783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:08.745064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:08.745367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:08.755496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:20:08.763013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:20:08.764187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:20:08.765342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 580/1180] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:20:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:20:08.770969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:08.868696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f07e6-1438-47e1-b773-145483dd68e0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:08.903034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:08.903695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:08.903981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:08.904262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:08.905005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:20:08.905341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:08.906701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:08.914807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 601/1181] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:20:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:08.920500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:08.950999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:09.019207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c3de3-fce6-41cb-b97e-74fbf7352eac None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:09.052784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:09.053668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:09.053952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:09.054226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] PATH_INFO: `/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:09.067625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbe3deff7dd4629b8f3d8bb8493311d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:09.069063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:09.070733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 581/1182] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:20:08 2022] GET /identity/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:09.076264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:09.133807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:09.177165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0b4a5-a6b9-450e-bce5-3bd11bbe43ce None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:09.211202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:09.211845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:09.212126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:09.212399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:09.276157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:09.277536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:09.329219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:09.373087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 602/1183] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:20:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:20:09.379744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:09.465871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:09.477551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1d37b-22d4-4151-bd39-da0933b77680 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:09.511548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:09.512400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:09.512682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:09.512956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] PATH_INFO: `/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:09.514143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] RBAC: Authorizing `identity:get_project(project_id=5f63baac30564ad8afa10d3aa0acfcfd)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:09.515576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3fb96b-8d43-45c7-8f44-e8db60f704f7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:09.517266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 582/1184] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:20:09 2022] GET /identity/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:09.523486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:09.620907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4a727-cb24-42b8-805c-410e21690c6e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:09.654316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:09.654974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:09.655261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:09.655537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:09.656357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=5f63baac30564ad8afa10d3aa0acfcfd, user.id=cbbe3deff7dd4629b8f3d8bb8493311d) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:20:09.656670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:09.658122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a0f5b-dfa6-4722-a901-af45c1d07e99 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:09.663709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 603/1185] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:20:09 2022] GET /identity/v3/role_assignments?user.id=cbbe3deff7dd4629b8f3d8bb8493311d&scope.project.id=5f63baac30564ad8afa10d3aa0acfcfd&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:11.890426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3e6a-db25-4e00-bd05-b64786544bdf None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:11.890949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3e6a-db25-4e00-bd05-b64786544bdf None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:11.891051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e3e6a-db25-4e00-bd05-b64786544bdf None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:11.892326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 583/1186] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:11.898624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:11.899062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:11.899192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:11.915731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:11.916912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:11.932198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:11.982821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 604/1187] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:12.006452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3e6a-db25-4e00-bd05-b64786544bdf None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:12.103985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e3e6a-db25-4e00-bd05-b64786544bdf None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:12.137004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:12.137813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:12.138099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:12.138372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:12.148148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:20:12.155570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:20:12.156763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:20:12.157843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 584/1188] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:20:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:20:12.163509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:12.258465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00751658-ec6a-4fb7-8358-1bce0b6f2df9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:12.291030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:12.291685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:12.291970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:12.292244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:12.292974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:20:12.293306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:12.294672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:12.302423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 605/1189] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:20:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:12.308325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:12.327786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:12.407673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089adca-2ed1-4150-867c-201116ae89a6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:12.439528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:12.440375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:12.441226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:12.441532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] PATH_INFO: `/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:12.442809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbe3deff7dd4629b8f3d8bb8493311d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:12.444240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:12.445880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 585/1190] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:20:12 2022] GET /identity/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:12.451663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:12.468359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:12.551819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d8c1f-a1da-490d-9289-fa91c2ca506e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:12.585371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:12.586218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:12.586497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:12.586766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] PATH_INFO: `/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:12.587928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] RBAC: Authorizing `identity:get_project(project_id=5f63baac30564ad8afa10d3aa0acfcfd)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:12.589381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6ba63-ddfd-4845-bec9-4820f1589d3b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:12.591063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 606/1191] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:20:12 2022] GET /identity/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:12.596959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:12.678749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:12.694647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4b7ec-b369-48d6-bf00-d3b3ba7e1235 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:12.728036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:12.728911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:12.729191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:12.729494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] PATH_INFO: `/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd/users/cbbe3deff7dd4629b8f3d8bb8493311d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:12.731455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5f63baac30564ad8afa10d3aa0acfcfd, user_id=cbbe3deff7dd4629b8f3d8bb8493311d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:12.732911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888ec99-3fbb-4005-ab2e-8c442d08d5c5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:12.808204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 586/1192] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:20:12 2022] PUT /identity/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd/users/cbbe3deff7dd4629b8f3d8bb8493311d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:20:14.962708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd718-8858-4f21-8596-573b61f36bb2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:14.963238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd718-8858-4f21-8596-573b61f36bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:14.963367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcd718-8858-4f21-8596-573b61f36bb2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:14.964637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 607/1193] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:20:14.969965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:14.970401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:14.970507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:14.987578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:20:14.988879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:20:15.053863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 587/1194] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:20:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:20:15.076707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcd718-8858-4f21-8596-573b61f36bb2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:15.155561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:15.175048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcd718-8858-4f21-8596-573b61f36bb2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:15.208806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:15.209604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:15.209883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:15.210155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:15.219736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:20:15.227249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:20:15.228379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:20:15.229478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 608/1195] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:20:15.234535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:15.306855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:15.330549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f8a87-46b0-4b8a-b4fb-b790f01c433e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:15.364479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:15.365135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:15.365455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:15.365733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:15.366469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:20:15.366773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:15.368175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:15.375997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 588/1196] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:15.382594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:15.481632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa17d62-d243-443c-9bc8-33c12e67147f None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:15.514686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:15.515552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:15.515838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:15.516116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] PATH_INFO: `/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:15.517314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] RBAC: Authorizing `identity:get_user(user_id=cbbe3deff7dd4629b8f3d8bb8493311d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:15.518815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:15.520801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 609/1197] 10.222.0.71 () {56 vars in 1177 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/users/cbbe3deff7dd4629b8f3d8bb8493311d => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:15.526567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:15.624026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c0471b-58dd-472d-b05d-f0fc9554ddf6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:15.658096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:15.658735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:15.659019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:15.659296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:15.662767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:15.725108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:15.726612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:15.822476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 589/1198] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:20:15.828219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:15.839386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:15.925472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601e0f7-083c-4d7b-bdc6-ae23a37893c2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:15.959611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204e038-262b-4771-869c-e302842505e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:15.960875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e038-262b-4771-869c-e302842505e6 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:15.960875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e038-262b-4771-869c-e302842505e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:15.961083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204e038-262b-4771-869c-e302842505e6 None admin] PATH_INFO: `/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:15.962198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e038-262b-4771-869c-e302842505e6 None admin] RBAC: Authorizing `identity:get_project(project_id=5f63baac30564ad8afa10d3aa0acfcfd)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:15.963607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1204e038-262b-4771-869c-e302842505e6 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:15.965373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 610/1199] 10.222.0.71 () {56 vars in 1186 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/projects/5f63baac30564ad8afa10d3aa0acfcfd => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:15.971379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:20:16.005679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:16.072282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e7f5d-ea7e-425b-bd3b-a632c742ed2b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:20:16.105313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:20:16.105899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:20:16.106177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:20:16.106448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:20:16.107266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=5f63baac30564ad8afa10d3aa0acfcfd, user.id=cbbe3deff7dd4629b8f3d8bb8493311d) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:20:16.107571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:20:16.108973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a464e-afb0-4765-b2c1-e87da47a09bc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:20:16.114599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 590/1200] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:20:15 2022] GET /identity/v3/role_assignments?user.id=cbbe3deff7dd4629b8f3d8bb8493311d&scope.project.id=5f63baac30564ad8afa10d3aa0acfcfd&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:20:25.953699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=62 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:20:26.112007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=50 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:37.744406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80e32-3be1-4ce8-a510-625f786846a2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:37.745035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80e32-3be1-4ce8-a510-625f786846a2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:37.745035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d80e32-3be1-4ce8-a510-625f786846a2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:37.746415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 611/1201] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:37.751661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:37.752094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:37.752220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:37.769433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:37.770616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:37.837012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 591/1202] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:21:37.862183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80e32-3be1-4ce8-a510-625f786846a2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:37.962106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d80e32-3be1-4ce8-a510-625f786846a2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:37.994684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:37.995462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:37.995745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:37.996020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:38.006409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:38.007831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:38.025686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:38.026777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:38.027759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:38.027759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:38.027759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:38.027759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:38.027759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 612/1203] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:38.033069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:38.131278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afeb348-82cd-416a-acb1-a55804d51054 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:38.159294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:38.164738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:38.165420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:38.165707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:38.165982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:38.166749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:38.167049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:38.168416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21c6465-2342-4144-8396-c02ee8c68c09 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:38.180082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 592/1204] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:38.185885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:38.240343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:38.286823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19edd6-86ac-4952-bb71-eba4000fee32 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:38.319869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:38.320538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:38.320821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:38.321096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:38.321831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:38.323251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba19e8-aee6-4a3c-8036-619d1d42d7b9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:38.426187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 613/1205] 10.222.0.71 () {60 vars in 1132 bytes} [Fri May 27 03:21:38 2022] POST /identity/v3/users => generated 251 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:21:40.632472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2ab3-88b9-45b2-8429-6ba070b25ce5 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:40.633010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2ab3-88b9-45b2-8429-6ba070b25ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:40.633010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2ab3-88b9-45b2-8429-6ba070b25ce5 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:40.634446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 593/1206] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:40.640222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:40.640618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:40.640781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:40.657205 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:40.658452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:40.722988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 614/1207] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:21:40.746898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef2ab3-88b9-45b2-8429-6ba070b25ce5 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:40.850280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef2ab3-88b9-45b2-8429-6ba070b25ce5 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:40.882913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:40.885983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:40.885983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:40.885983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:40.894800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:21:40.902321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:40.904000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:40.904864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 594/1208] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:21:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:40.910232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:40.947853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:41.004575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c51e2c-35a5-4f15-adb8-7ae7ed4e5c6a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.038088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.038740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.039019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.039292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.040023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:41.040321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.041697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:41.050099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 615/1209] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:21:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:41.055747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:41.108139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:41.157830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ccb00-7346-4eba-829b-9f33c2738d44 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.192008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.192789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.193067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.193365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.204133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.205593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:41.222517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:41.223610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:41.224904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:41.224904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:41.224904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:41.224904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:41.224904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 595/1210] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:41.229563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:41.326562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:41.329461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb077d-68d9-40cc-9089-040769a01e30 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.361807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.362402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.362687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.362966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.363678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:41.363984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.365397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:41.376756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 616/1211] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:41.382401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:41.483040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0046ada-349f-40cd-ae22-fb7a6734c25b None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.484544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:41.516039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.516878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.517163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.517470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.524741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.525959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:21:41.541033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:41.542968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:41.544535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 596/1212] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:41.548887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:41.647472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1694f3-9481-4385-b892-fb37d46faf4e None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.679769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.680427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.680708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.681054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.681903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:41.682212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.683637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:41.701035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 617/1213] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:21:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:41.706735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:41.805801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141a430-e7bc-43b7-b9da-e9af036f56c7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:41.841422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:41.842115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:41.842400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:41.842675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:41.872800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:41.910537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:41.911936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.010783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 597/1214] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:21:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:21:42.017277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:42.036892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:42.119190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ec9e-6d80-4ac8-add9-b05ffe0829a3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:42.152210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:42.152990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:42.153901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:42.154177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:42.164157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:42.165565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:42.183425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:42.184511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:42.185545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:42.185545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:42.185545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:42.185545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:42.185545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 618/1215] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:42.191414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:42.252460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:42.289807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537251e9-7905-4219-bf59-f26fe013ba5e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:42.323334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:42.323979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:42.324257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:42.324527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:42.325771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:42.326070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:42.327510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.338891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 598/1216] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:42.345580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:42.414342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:42.444386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74356a9-ce09-4a24-93ad-901eeab3e388 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:42.478076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:42.478854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:42.479132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:42.479403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:42.486104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:42.487522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:21:42.501530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:42.502609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:42.503550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 619/1217] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:21:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:42.508608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:42.609020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83bb674-633b-448e-9540-0368e92ada94 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:42.631540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:42.643499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:42.644181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:42.644476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:42.644748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:42.645572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:42.645885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:42.647315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239fd3-e96b-4f89-ba17-1d745053a71e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.659058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 599/1218] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:21:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:42.665341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:42.764737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab27f10-c95a-445a-9ee9-168e1b524587 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:42.792913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:42.798860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:42.799512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:42.799798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:42.800077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:42.800926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=f25676e7b2c74e65b86b758cfdccf216) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:42.801238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:42.804185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8860c75f-a5a4-4204-af59-0c7d8c89c542 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:42.808142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 620/1219] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:21:42 2022] GET /identity/v3/role_assignments?user.id=f25676e7b2c74e65b86b758cfdccf216&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:44.990850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfec480-8c7b-40d6-a0ec-a2aae4dcc838 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:44.991403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfec480-8c7b-40d6-a0ec-a2aae4dcc838 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:44.991403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfec480-8c7b-40d6-a0ec-a2aae4dcc838 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:44.992797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 600/1220] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:44.998525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:44.998952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:44.999085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.015819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:45.017016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:45.084233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 621/1221] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:21:45.108143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfec480-8c7b-40d6-a0ec-a2aae4dcc838 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.209464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfec480-8c7b-40d6-a0ec-a2aae4dcc838 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:45.243948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:45.244670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.244952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.245228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.255263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:21:45.263051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:45.264184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:45.265160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 601/1222] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:45.270429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.370532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e3de-9dbb-46bd-82b7-753ff7d36409 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:45.394615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:45.405781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:45.406452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.406735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.407011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.407753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] RBAC: Adding query filter params (name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:45.408060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:45.409478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:45.417208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 622/1223] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:45.423946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.466654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:45.520648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a14353-d447-4a4e-9aeb-4c12fdf4da1c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:45.555109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:45.555940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.556226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.556503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.566842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:45.568284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:45.586083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:45.587180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:45.588321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:45.588321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:45.588321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:45.588321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:45.588321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 602/1224] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:45.593922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.692889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6693fc-f565-43ce-85c3-b183d21aa247 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:45.726894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:45.727546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.727828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.728102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.728895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:45.729200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:45.730575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:45.742059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 623/1225] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:45.748405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.843301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:45.849691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5291ff9-7316-4d34-a48c-7573a62b42bc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:45.882033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:45.884169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:45.884169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:45.884169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:45.891368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:45.892822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:21:45.907629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:45.908746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:45.909939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 603/1226] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:45.914848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:45.959604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:46.011423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62667a5e-dbed-47f1-a93d-3784786dc501 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.044379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.045048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.045363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.045669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.046565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:46.046876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.048313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.065391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 624/1227] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:21:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:46.071282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:46.174772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48888232-e747-4bb9-bc5b-2ed2821b4c6a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.209052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.210139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.210426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.210703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.221353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.222794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:46.241295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:46.242403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:46.243527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:46.243527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:46.243527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:46.243527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:46.243527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 604/1228] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:46.249048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:46.346729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fec4-ecc1-4d15-b604-cee32bc0b609 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.348966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:46.380160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.380819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.381100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.381404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.382112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:46.382416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.383765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.395208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 625/1229] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:46.400906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:46.410711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:46.498568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f850c-04e4-47fb-803e-05422863f9fa None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.531986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.532778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.533064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.533371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.540307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.541796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:21:46.556292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:46.557403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:46.558738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 605/1230] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:21:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:46.563419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:46.664406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268d86d-dec7-43bd-86dd-3ecafff2e0a1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.698362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.699021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.699306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.699583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.701339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:46.701653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.703180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd8462-9d5b-4f84-865d-0b9da8d4270f None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.715174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 626/1231] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:21:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:46.722114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:46.787147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:46.820299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f12f628-e094-4587-a6ea-2d65eff50fe0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:46.854401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:46.855279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:46.855554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:46.855827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/f25676e7b2c74e65b86b758cfdccf216/roles/0074472689b54cc7aeffdb8d6ee64995` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:46.869571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=f25676e7b2c74e65b86b758cfdccf216, role_id=0074472689b54cc7aeffdb8d6ee64995)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:46.872493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6463ee73-0a54-4b3c-a1bd-b9bb1329bd75 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:46.956896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 606/1232] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:21:46 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/f25676e7b2c74e65b86b758cfdccf216/roles/0074472689b54cc7aeffdb8d6ee64995 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:21:49.150819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262301-c693-40d7-a0a6-ec8e60372831 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.151358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262301-c693-40d7-a0a6-ec8e60372831 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.151469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb262301-c693-40d7-a0a6-ec8e60372831 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.152758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 627/1233] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:49.158504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.158909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.159050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.176124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:49.178345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:49.244957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 607/1234] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:21:49.268303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262301-c693-40d7-a0a6-ec8e60372831 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:49.293517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:49.369756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb262301-c693-40d7-a0a6-ec8e60372831 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:49.403863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:49.405383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.405878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.406165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.416337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:21:49.424555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:49.425710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:49.426615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 628/1235] 10.222.0.71 () {56 vars in 1102 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:49.431893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:49.477495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:49.528296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae40806-e8fc-4337-8785-a23595d42a5d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:49.563067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:49.563784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.564065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.564339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.565078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] RBAC: Adding query filter params (name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:49.565417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:49.571836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:49.574648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 608/1236] 10.222.0.71 () {56 vars in 1103 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:49.580943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:49.664949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:49.679739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17081c-1cb7-4379-b83d-400314c620e1 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:49.714052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:49.714855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.715153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.715591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.725736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:49.727213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:49.744246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:49.751204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:49.752379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:49.752379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:49.752379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:49.752379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:49.752379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 629/1237] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:49.752723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:49.851422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc331fe4-fb9c-4538-95ec-d18dfec550db None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:49.860614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:49.885053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:49.885736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:49.886025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:49.886304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:49.887021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:49.887329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:49.888690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:49.900949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 609/1238] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:49.906790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.003930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c96a36-a6d9-4c77-bb84-30970da4c9cd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:50.037321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:50.038110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:50.038390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:50.038662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:50.041315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:50.046516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:50.047935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:21:50.062801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:50.063949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:50.065136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 630/1239] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:50.070041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.171996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c85700-50ad-4497-b0cc-c77f06b5ce2e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:50.205413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:50.206076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:50.206360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:50.206628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:50.207449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:50.207757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:50.209188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:50.226088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 610/1240] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:21:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:50.231956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.333568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290797a4-0768-4ae9-915c-1ee739639a45 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:50.367674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:50.368316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:50.368598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:50.368874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:50.429091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:50.435407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:50.437526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:50.533371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 631/1241] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:21:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:21:50.539030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.566783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:50.637428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa11d1-3231-40e7-85cb-f16cb18df9a7 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:50.671419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:50.672208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:50.672490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:50.672764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:50.682485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:50.683987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:50.702211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:50.703289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:50.704581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:50.704581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:50.704581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:50.704581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:50.704581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 611/1242] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:50.709125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.809740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:50.815723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3caf4d-3110-46e8-94ee-a0107daf603d None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:50.850070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:50.850726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:50.851008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:50.851283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:50.851985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:50.852289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:50.853677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:50.864625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 632/1243] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:50.870327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:50.947287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:50.969041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbb6b5c-9f25-41d3-82bc-041d30c8ade0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:51.000827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:51.001633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:51.001913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:51.002183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:51.008563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:51.010025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:21:51.023856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:51.024916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:51.025961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 612/1244] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:21:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:51.031798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:51.132546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43a130-607b-4eb1-8113-3d1e0b5d58d9 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:51.166572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:51.167224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:51.167509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:51.167786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:51.168555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:51.168864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:51.170368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb6f56-0414-426b-b123-9fad388076f3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:51.182232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 633/1245] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:21:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:21:51.189302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:51.288217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17340916-0142-4b3a-84ae-0c4d9159002c None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:51.321693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:51.322336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:51.322623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:51.322901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:51.323722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] RBAC: Adding query filter params (role.id=0074472689b54cc7aeffdb8d6ee64995, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=f25676e7b2c74e65b86b758cfdccf216) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:51.324035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:51.325493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0e81c-56fc-4476-8f67-8664d097b7c8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:51.332205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 613/1246] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:21:51 2022] GET /identity/v3/role_assignments?user.id=f25676e7b2c74e65b86b758cfdccf216&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=0074472689b54cc7aeffdb8d6ee64995 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:53.620350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e9d5-e28e-4aca-bb8e-a5fa5b28be57 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:53.620945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e9d5-e28e-4aca-bb8e-a5fa5b28be57 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:53.620945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e9d5-e28e-4aca-bb8e-a5fa5b28be57 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:53.622303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 634/1247] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:53.627762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:53.628190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:53.628327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:53.633364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:53.645151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:53.646431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:53.711253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 614/1248] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:21:53.735446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e9d5-e28e-4aca-bb8e-a5fa5b28be57 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:53.754011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:53.837015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e9d5-e28e-4aca-bb8e-a5fa5b28be57 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:53.870259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:53.871040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:53.871319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:53.871590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:53.881752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:21:53.889884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:53.891076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:53.892408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 635/1249] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:21:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:53.897032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:53.995319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889149c4-5ebb-4de2-a79f-e111af6b36d8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.023955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:54.028800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.030084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.030369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.030645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.031478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:54.031783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.033146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.041061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 615/1250] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:21:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:54.047098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:54.122875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:54.145403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfee0a-8e92-41ae-b630-bb402c6e99d8 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.178158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.178941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.179222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.179495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.190640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.192118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:54.209742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:54.211237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:54.212398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:54.212398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:54.212398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:54.212398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:54.212398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 636/1251] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:54.217491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:54.315561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e077b-a682-44c5-bd4c-9d47d5232f83 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.348803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.349484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.349888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.350168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.350882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:54.351188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.352546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.365720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 616/1252] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:54.371476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:54.471888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb8b78-2ebc-4ede-9177-13fc6edc138c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.496856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:54.505248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.506079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.506367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.506642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.514940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.516590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:21:54.531425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:54.532482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:54.534024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 637/1253] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:54.538623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:54.594079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:54.637664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bbab2-841b-42d5-9dcf-a437839a121d None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.672237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.672896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.673180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.673489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.674318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:54.674692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.676200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.693686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 617/1254] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:21:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:54.699256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:54.799099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e2176-61aa-4570-958e-59ca97f6cf6b None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:54.832643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:54.833314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:54.833606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:54.833882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:54.889200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:54.900932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:54.902456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:54.998895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 638/1255] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:21:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 03:21:55.004880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:55.102130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c48c1-b04c-47a7-9169-1187d7823b6e None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:55.115768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:55.135497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:55.136274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:55.136551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:55.136819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:55.146573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:55.147998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:55.165434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:55.166392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:55.167509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:55.167509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:55.167509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:55.167509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:55.167509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 618/1256] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:55.172990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:55.259750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:55.271710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f3034b-7a40-44f9-8150-73221ca3a9d4 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:55.303996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:55.304652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:55.304931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:55.305205 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:55.305935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:55.306237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:55.307576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:55.319866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 639/1257] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:55.325534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:55.426867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dece5-911b-4297-8755-8ee1615eb724 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:55.461288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:55.462080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:55.462367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:55.462640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:55.469730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:55.471158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:21:55.485588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:55.486727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:21:55.487665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 619/1258] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:21:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:55.492848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:55.593830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4082c7c-9df8-4dfb-9df0-b15d8fb870b2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:55.627680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:55.628333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:55.628616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:55.628892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:55.629726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:55.634860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:55.634860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa85876-af91-42a6-abcb-dcbffda34a4c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:55.644429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 640/1259] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:21:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:55.650782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:55.676757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:55.751571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381df3b-2c55-47cd-8fb2-8f60533cddff None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:55.786676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:55.787325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:55.787605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:55.787878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:55.788797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=f25676e7b2c74e65b86b758cfdccf216) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:55.789109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:55.790565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec05af-6d82-4f37-8be8-25b1847fc880 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:55.797070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 620/1260] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:21:55 2022] GET /identity/v3/role_assignments?user.id=f25676e7b2c74e65b86b758cfdccf216&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:57.958076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00589e7-f1cd-4eca-89d0-9a7e3176b7b0 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:57.958633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00589e7-f1cd-4eca-89d0-9a7e3176b7b0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:57.958633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00589e7-f1cd-4eca-89d0-9a7e3176b7b0 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:57.960252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 641/1261] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:21:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:21:57.965628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:57.966005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:57.966185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:57.983217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:21:57.984439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:21:58.051408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 621/1262] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:21:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 03:21:58.074559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00589e7-f1cd-4eca-89d0-9a7e3176b7b0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.086359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:58.178136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00589e7-f1cd-4eca-89d0-9a7e3176b7b0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:58.211219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:58.211948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:58.212287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:58.212568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:58.223065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:21:58.230860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:58.237621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:58.238495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 642/1263] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:58.239211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.257048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:58.337514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fe85b-b54b-4051-8486-0845d8c82ba9 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:58.372461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:58.373372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:58.373659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:58.373934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:58.374676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:58.374978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:58.376355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:58.384788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 622/1264] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:58.391342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.457131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:58.490867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec1cf-c087-4b3a-a997-6596a2c66df2 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:58.528779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:58.530518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:58.530805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:58.531083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:58.544358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:58.546703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:58.564448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:58.565572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:58.566534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:58.566534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:58.566534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:58.566534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:58.566534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 643/1265] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:58.571516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.652558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:58.672104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4ade-3775-4637-b007-dbbdaefa20d0 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:58.704790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:58.705459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:58.705740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:58.706014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:58.706718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:58.707023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:58.708456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:58.720070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 623/1266] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:58.725814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.828116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d33d8-5781-4166-81c5-7faa28253673 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:58.848300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:58.862710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:58.863514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:58.863798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:58.864075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:58.871310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:58.874465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:21:58.887054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:58.888206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:58.889538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 644/1267] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:58.894195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:58.993232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6cc94-79cb-4b37-b1e8-6d0a32fe0eaa None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.025901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.026561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.026848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.027125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.027954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:59.028264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.029835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.039274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:59.048407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 624/1268] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:21:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:59.054241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:59.154185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc4cfd-18dd-4759-afe0-b7c9cf377610 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.188430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.189233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.189554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.189874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.200193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.201716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:21:59.220578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:59.221704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:59.222828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:21:59.222828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:21:59.222828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:21:59.222828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:59.222828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 645/1269] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:21:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:59.227635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:59.325237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b7fa-7ed8-4201-b935-1b37c3fdaf07 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.361352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.362032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.362320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.362597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.363333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:59.363643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.365173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.376462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 625/1270] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:59.382305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:59.414983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:59.482435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf68844-e0eb-4c0e-bae4-38d495cee3a7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.516750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.517565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.517846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.518120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.525584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.527011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:21:59.540763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:21:59.542077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:21:59.543336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 646/1271] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:21:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:21:59.552909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:59.613309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:59.654668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc7e79-9b09-4019-9a91-36d71c7b5d08 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.687513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5ce40-7755-4824-be06-368570493911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.688103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ce40-7755-4824-be06-368570493911 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.688388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ce40-7755-4824-be06-368570493911 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.688664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5ce40-7755-4824-be06-368570493911 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.689472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5ce40-7755-4824-be06-368570493911 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:21:59.689779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5ce40-7755-4824-be06-368570493911 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.691222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5ce40-7755-4824-be06-368570493911 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.704338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 626/1272] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:21:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:21:59.710620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:21:59.802059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:21:59.810709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b175105-e287-4ee1-9f83-52705adc6741 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:21:59.844254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:21:59.845133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:21:59.845478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:21:59.845762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] PATH_INFO: `/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/f25676e7b2c74e65b86b758cfdccf216/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:21:59.847801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=194b0ced8c1a40bf970740516d7c1702, user_id=f25676e7b2c74e65b86b758cfdccf216, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:21:59.849224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cc7fe-15c8-4bae-a96a-7063f7fd53c5 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:21:59.985903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 647/1273] 10.222.0.71 () {58 vars in 1439 bytes} [Fri May 27 03:21:59 2022] PUT /identity/v3/projects/194b0ced8c1a40bf970740516d7c1702/users/f25676e7b2c74e65b86b758cfdccf216/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:22:02.202490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476311f9-e4c7-4214-9612-98b46feaa785 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.203059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476311f9-e4c7-4214-9612-98b46feaa785 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.203219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476311f9-e4c7-4214-9612-98b46feaa785 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.204635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 627/1274] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:02.210041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.210683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.210878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.228046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:02.231903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:02.293794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 648/1275] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:22:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:22:02.316684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476311f9-e4c7-4214-9612-98b46feaa785 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:02.419627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476311f9-e4c7-4214-9612-98b46feaa785 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:02.438125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:02.455453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:02.456177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.456459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.456732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.466907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 03:22:02.474814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:02.475934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:02.477207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 628/1276] 10.222.0.71 () {56 vars in 1096 bytes} [Fri May 27 03:22:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:02.482292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:02.565559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:02.583308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16463a-1f70-4e5f-8a22-05f458df2f6f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:02.616253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:02.616925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.617210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.617553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.618304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:02.618617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:02.620063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:02.628998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 649/1277] 10.222.0.71 () {56 vars in 1099 bytes} [Fri May 27 03:22:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:02.634862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:02.741312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae7d6-9d72-4f19-9c2a-cda6081d0ba4 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:02.775459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:02.776244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.776532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.776811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.787393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:02.788847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:22:02.806280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:02.807858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:02.809324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:22:02.809324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:22:02.809324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:22:02.809324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:02.809324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 629/1278] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:22:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:02.814145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:02.914061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec662712-7870-4afb-b36b-8583f0b46e59 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:02.947260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:02.947912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:02.948201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:02.948478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:02.949186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:02.949524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:02.950897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:02.963783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 650/1279] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:22:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:02.969708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:03.001374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:03.069562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d83835-cdbf-4bdc-8722-ac3316824adb None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:03.102475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:03.103275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:03.103557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:03.103832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:03.111304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:03.121286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 03:22:03.127679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:03.128818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:03.130017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 630/1280] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:22:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:03.134872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:03.139789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:03.235135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d6592-678d-42ec-914e-a344aee4b9dd None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:03.267032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:03.267634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:03.267916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:03.268193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:03.269007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:03.269343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:03.270778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:03.287854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 651/1281] 10.222.0.71 () {56 vars in 1143 bytes} [Fri May 27 03:22:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:22:03.293733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:03.383904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:03.393629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1c39fc-d1ee-42f6-ba05-33b7f00ae0f1 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:03.427304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:03.428053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:03.428340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:03.428621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:03.497753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:03.499611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:03.589280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:03.599749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 631/1282] 10.222.0.71 () {58 vars in 1282 bytes} [Fri May 27 03:22:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 03:22:03.605764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:03.668200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:03.706282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b7f54-e81b-445c-a7e4-fbd490182be3 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:03.740959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:03.741785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:03.742076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:03.742355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:03.752763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:03.754222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 03:22:03.772037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:03.774599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:03.775563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 03:22:03.775563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 03:22:03.775563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 03:22:03.775563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:22:03.775563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 652/1283] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:22:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:03.779389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:03.876621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a0d6e-3e39-4928-9b1a-607037adb20a None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:03.911205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:03.911837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:03.912117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:03.912386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:03.913120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:03.913456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:03.914864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:03.926133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 632/1284] 10.222.0.71 () {56 vars in 1109 bytes} [Fri May 27 03:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:03.932056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:04.033436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7d735-17e8-4f9a-960a-37b6ce05248c None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:04.047208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:04.067639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:04.068465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.068777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.069080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.076210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:04.078380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 03:22:04.093455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application with Lock( May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:04.094536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: ERROR keystone.server.flask.application May 27 03:22:04.095694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 653/1285] 10.222.0.71 () {56 vars in 1111 bytes} [Fri May 27 03:22:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:22:04.100749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:04.151595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:04.200354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762e07d-8883-495a-8681-f153bca608e8 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:04.233986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:04.234636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.234919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.235191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.235968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:04.236274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:04.237746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977506e2-b5c5-4d32-ae9e-423467c82775 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:04.250072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 633/1286] 10.222.0.71 () {56 vars in 1148 bytes} [Fri May 27 03:22:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:04.256391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:04.355397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac92f0-1126-45c4-a49a-ea1a89443369 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:04.390419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:04.391072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:04.391357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:04.391634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:04.392463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] RBAC: Adding query filter params (role.id=ae01c02711814ca9b85abb5cb767fea3, scope.project.id=194b0ced8c1a40bf970740516d7c1702, user.id=f25676e7b2c74e65b86b758cfdccf216) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:04.392772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:04.394220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb23906-ad39-4363-ac62-32b22275169e None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:04.400059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 654/1287] 10.222.0.71 () {56 vars in 1374 bytes} [Fri May 27 03:22:04 2022] GET /identity/v3/role_assignments?user.id=f25676e7b2c74e65b86b758cfdccf216&scope.project.id=194b0ced8c1a40bf970740516d7c1702&role.id=ae01c02711814ca9b85abb5cb767fea3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:06.611741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc49-dd2b-4b2e-9807-93c8957e3077 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:06.612321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc49-dd2b-4b2e-9807-93c8957e3077 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:06.612321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223dc49-dd2b-4b2e-9807-93c8957e3077 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:06.613832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 634/1288] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:22:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:06.618873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:06.619248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:06.619430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:06.636543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:06.637757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:06.667431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:06.704700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 655/1289] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:22:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:22:06.727353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dc49-dd2b-4b2e-9807-93c8957e3077 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:06.830943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223dc49-dd2b-4b2e-9807-93c8957e3077 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:06.842878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:06.870497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:06.871290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:06.871570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:06.871841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:06.872482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:06.874586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:06.886220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:06.887275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:06.888128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 635/1290] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:22:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 03:22:06.893704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:06.990814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6831440-4d6e-4646-912f-80b1f3aab0e7 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:07.022977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:07.023660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:07.023943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:07.024216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:07.024909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:07.025216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:07.026618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ffb7-abba-4276-8ddd-a5b1034dd145 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:07.032072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 656/1291] 10.222.0.71 () {56 vars in 1116 bytes} [Fri May 27 03:22:06 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:07.037736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:07.138290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3046ea05-db6a-4cce-8871-e6746a974691 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:07.171873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:07.172522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:07.172803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:07.173077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] PATH_INFO: `/v3/services` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:07.173812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:07.174116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:07.175486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254be00-8c14-4e16-a310-2e003eed13b5 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:07.179803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 636/1292] 10.222.0.71 () {56 vars in 1116 bytes} [Fri May 27 03:22:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:09.360083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52740c-006d-4e64-a6ff-6e8e820d4cfe None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:09.360610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52740c-006d-4e64-a6ff-6e8e820d4cfe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:09.360724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52740c-006d-4e64-a6ff-6e8e820d4cfe None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:09.362045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 657/1293] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:22:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:09.367315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3d72-96b0-4ed5-8bcd-a5012e668a8c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:09.367765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3d72-96b0-4ed5-8bcd-a5012e668a8c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:09.367861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd3d72-96b0-4ed5-8bcd-a5012e668a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:09.385945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3fdd3d72-96b0-4ed5-8bcd-a5012e668a8c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:09.387133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3fdd3d72-96b0-4ed5-8bcd-a5012e668a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:09.416248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:09.453048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 637/1294] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:22:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:22:09.477409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52740c-006d-4e64-a6ff-6e8e820d4cfe None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:09.509601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:09.582533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52740c-006d-4e64-a6ff-6e8e820d4cfe None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:09.624866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:09.624866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:09.624866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:09.624866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:09.625285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:09.625285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdd957-a359-42c0-be5b-93a20ea90d94 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:09.740360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 658/1295] 10.222.0.71 () {60 vars in 1141 bytes} [Fri May 27 03:22:09 2022] POST /identity/v3/services => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:22:11.977819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48cf92-4bcf-4d2e-8c7d-2a9a52fdda1d None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:11.978394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48cf92-4bcf-4d2e-8c7d-2a9a52fdda1d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:11.978394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48cf92-4bcf-4d2e-8c7d-2a9a52fdda1d None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:11.979739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 638/1296] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:22:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:11.985331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:11.985729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:11.985904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:12.002369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:12.003530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:12.074306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 659/1297] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:22:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:22:12.098209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48cf92-4bcf-4d2e-8c7d-2a9a52fdda1d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:12.196774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48cf92-4bcf-4d2e-8c7d-2a9a52fdda1d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:12.233213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:12.233213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:12.233213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:12.233213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:12.233729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:12.233729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:12.244991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:12.246196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:12.247184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 639/1298] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:22:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:12.253171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:12.271871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:12.349896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a04679-04d7-4341-bcb9-7985c57c7088 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:12.383902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:12.384562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:12.384847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:12.385124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:12.385854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:12.386165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:12.387528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:12.394295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 660/1299] 10.222.0.71 () {56 vars in 1116 bytes} [Fri May 27 03:22:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:22:12.400164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:12.431409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:12.499758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7877694-3928-4996-87dc-a8b0ca3aa6dc None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:12.535411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:12.536161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:12.536412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:12.536688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:12.537504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] RBAC: Adding query filter params (interface=public, service_id=0d29e5d26a6b4a0f9505fb7531bf2676, region_id=RegionOne) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:12.537886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:12.539251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fee95e-72d6-48fd-90aa-f451509a47b0 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:12.544573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 640/1300] 10.222.0.71 () {56 vars in 1251 bytes} [Fri May 27 03:22:12 2022] GET /identity/v3/endpoints?service_id=0d29e5d26a6b4a0f9505fb7531bf2676&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:22:12.550674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:12.629822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:12.647048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169545e-b644-4e34-b0f1-431dc95822d7 None admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:12.681728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:12.682394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:12.682680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:12.682957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:12.683658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:12.685061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ab5be-bd73-4592-9e1c-f5aeb4b05a00 None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:12.693324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 661/1301] 10.222.0.71 () {56 vars in 1087 bytes} [Fri May 27 03:22:12 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:22:14.912043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f32a-56ee-41fe-8465-9c054c389025 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:14.912592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f32a-56ee-41fe-8465-9c054c389025 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:14.912592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e76f32a-56ee-41fe-8465-9c054c389025 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:14.914008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 641/1302] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:22:14.919238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:14.919644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:14.919794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:14.938377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:22:14.939590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:22:15.005615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 662/1303] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:22:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 03:22:15.028524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f32a-56ee-41fe-8465-9c054c389025 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:15.125475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:15.131983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e76f32a-56ee-41fe-8465-9c054c389025 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:15.167773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:15.168497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:15.168855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:15.169125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:15.169801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:15.171835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 03:22:15.184438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 03:22:15.185641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.get_or_create( May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application with Lock( May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self._enter() May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application return self.creator() May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application created_value = creator( May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: ERROR keystone.server.flask.application May 27 03:22:15.186909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 642/1304] 10.222.0.71 () {56 vars in 1117 bytes} [Fri May 27 03:22:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 03:22:15.192054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:15.267404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:15.289463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca1f310-b3f1-4824-8771-fd17cfaa5dcd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:15.322687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:15.323340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:15.323619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:15.323892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] PATH_INFO: `/v3/services` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:15.324580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:22:15.324883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:15.326352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d36b5ba-fdd7-4b74-b8c0-f9907614742d None admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:15.331433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 663/1305] 10.222.0.71 () {56 vars in 1116 bytes} [Fri May 27 03:22:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:22:15.337606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:22:15.437596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26958e02-b20f-4232-8db6-4a90162c8fe6 None admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:22:15.472237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:22:15.472886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:22:15.473170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:22:15.473477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:22:15.474211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:22:15.475571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540909ab-30a8-4392-858e-60dddc4e8aa3 None admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:22:15.580424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 643/1306] 10.222.0.71 () {60 vars in 1144 bytes} [Fri May 27 03:22:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:22:25.328982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=30 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:22:25.574957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:08.905167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afae18-fe35-40d9-b0ee-0cdb13696c57 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:08.905928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afae18-fe35-40d9-b0ee-0cdb13696c57 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:08.905928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4afae18-fe35-40d9-b0ee-0cdb13696c57 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:08.912799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6df65-2a0b-411f-b20e-8c20f22f66df None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:08.913316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6df65-2a0b-411f-b20e-8c20f22f66df None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:08.913421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e6df65-2a0b-411f-b20e-8c20f22f66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:08.917751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 664/1307] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:09.048493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e0e6df65-2a0b-411f-b20e-8c20f22f66df None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:09.049903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e0e6df65-2a0b-411f-b20e-8c20f22f66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:09.249575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 644/1308] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:09.315324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:09.316047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:09.316480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:09.319850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 665/1309] 10.222.0.71 () {54 vars in 964 bytes} [Fri May 27 03:29:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:09.327884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfad-e0e5-4249-83c0-111b2abfb55c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:09.328176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfad-e0e5-4249-83c0-111b2abfb55c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:09.328448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0851bfad-e0e5-4249-83c0-111b2abfb55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:09.414552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0851bfad-e0e5-4249-83c0-111b2abfb55c None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:09.415793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0851bfad-e0e5-4249-83c0-111b2abfb55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:09.454701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:09.515853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 645/1310] 10.222.0.71 () {58 vars in 1061 bytes} [Fri May 27 03:29:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:09.525682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:09.527433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:09.650785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef4fbb-d077-4e11-b129-e51018722443 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:09.729539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:09.730299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:09.730651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:09.731018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:09.733476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:09.793566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:09.851265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:09.852710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bf2c2-f390-48a5-9e0f-4c63d4a7bf61 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:09.874356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 666/1311] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:12.396258 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:12.396779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:12.396891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:12.400911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 646/1312] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:12.403513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582580-db83-43e7-ada0-a72016a48643 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:12.404264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582580-db83-43e7-ada0-a72016a48643 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:12.404264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74582580-db83-43e7-ada0-a72016a48643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:12.491054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-74582580-db83-43e7-ada0-a72016a48643 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:12.492760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-74582580-db83-43e7-ada0-a72016a48643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:12.600083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 667/1313] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:12.638063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:12.640285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:12.747529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf0837-47b5-44bf-ac9c-26c6a6e36d12 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:12.828665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:12.832181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:12.832874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:12.833163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:12.833471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:12.835109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:12.959367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:12.960836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeda3ac-e81d-4bfc-9658-2d41da61ce70 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:12.981626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 647/1314] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:15.673280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.673824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.673824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.675204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 668/1315] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:15.680417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802ddc-bd9a-4488-b9ec-df67aa4c0a82 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:15.680861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802ddc-bd9a-4488-b9ec-df67aa4c0a82 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:15.680966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21802ddc-bd9a-4488-b9ec-df67aa4c0a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:15.744399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-21802ddc-bd9a-4488-b9ec-df67aa4c0a82 None None] MFA Rules not processed for user `6b3fcf37bafd4606adaa01cb3322f5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:15.745667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-21802ddc-bd9a-4488-b9ec-df67aa4c0a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:15.797039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:15.842180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 648/1316] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:15.881408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:15.882937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:15.893232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:15.984907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed143b4-3350-4142-9c4a-90cd51e0b2ee None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:16.057664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:16.058325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:16.058617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:16.058899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:16.061409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:16.125344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:16.173195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:16.174534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296dccb7-36a0-464e-8eb8-0641de1a8ce1 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:16.195104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 669/1317] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:19.344027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:19.344565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:19.344565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:19.346158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 649/1318] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:19.351530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335376-d249-4039-8b57-50c9b9a88a94 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:19.352022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335376-d249-4039-8b57-50c9b9a88a94 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:19.352153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8335376-d249-4039-8b57-50c9b9a88a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:19.416351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a8335376-d249-4039-8b57-50c9b9a88a94 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:19.417572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a8335376-d249-4039-8b57-50c9b9a88a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:19.513616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 670/1319] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:19.553083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:19.554647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:19.655326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ddeec0-57bc-4495-9cae-31a395c672ff None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:19.725991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:19.726660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:19.726943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:19.727219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:19.728820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:19.736973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:19.837326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:19.839105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c829fa72-f1f9-4f26-91c9-611779ebd81b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:19.858356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 650/1320] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:23.054277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:23.054817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:23.054817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:23.056207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 671/1321] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:23.062068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6fcb-17ce-4cb0-93c5-da8cfcc2ef58 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:23.062523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6fcb-17ce-4cb0-93c5-da8cfcc2ef58 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:23.062620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a6fcb-17ce-4cb0-93c5-da8cfcc2ef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:23.128320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6b1a6fcb-17ce-4cb0-93c5-da8cfcc2ef58 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:23.129549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6b1a6fcb-17ce-4cb0-93c5-da8cfcc2ef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:23.187115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:23.226842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 651/1322] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:23.262882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:23.264568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:23.284597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:23.369872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f9151-8c35-4c3c-9243-c13d5002f86f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:23.443403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:23.443966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:23.444246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:23.444530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:23.446165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:23.517750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:23.558332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:23.560134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455435f-4940-4b6f-b626-0fb03f41f715 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:23.579820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 672/1323] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:25.851001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24163-008d-4c40-90df-65622056b099 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:25.851503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24163-008d-4c40-90df-65622056b099 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:25.851503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c24163-008d-4c40-90df-65622056b099 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:25.852847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 652/1324] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:25.858220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031049-3679-4c5c-9e08-5097a6b2fd6b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:25.858656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031049-3679-4c5c-9e08-5097a6b2fd6b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:25.858820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff031049-3679-4c5c-9e08-5097a6b2fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:25.924255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ff031049-3679-4c5c-9e08-5097a6b2fd6b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:25.925506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ff031049-3679-4c5c-9e08-5097a6b2fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:26.023871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 673/1325] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:26.059468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24163-008d-4c40-90df-65622056b099 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:26.061003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-01c24163-008d-4c40-90df-65622056b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:26.165746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c24163-008d-4c40-90df-65622056b099 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:26.241735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:26.242382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:26.242663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:26.243015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:26.244548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:26.261650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:26.357623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:26.359060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7e4f5-fb3a-48da-8e93-86bdd5b2015d service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:26.377426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 653/1326] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:28.624128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:28.624659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:28.624659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:28.626066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 674/1327] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:28.632448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74409e6-c4f5-4e79-a12b-ee304ada1149 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:28.632864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74409e6-c4f5-4e79-a12b-ee304ada1149 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:28.633148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74409e6-c4f5-4e79-a12b-ee304ada1149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:28.698104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d74409e6-c4f5-4e79-a12b-ee304ada1149 None None] MFA Rules not processed for user `6b3fcf37bafd4606adaa01cb3322f5f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:28.699358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d74409e6-c4f5-4e79-a12b-ee304ada1149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:28.766394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:28.798417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 654/1328] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:28 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:28.836696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:28.838247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:28.869879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:28.945586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a88eb-7a77-4bd0-932e-65b19fbf1d52 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:29.025459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:29.026121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:29.026405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:29.026676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:29.029010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:29.108481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:29.140080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:29.141541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459eb81-6981-4d5b-b4f9-a2b2d855e771 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:29.159957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 675/1329] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:28 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:31.837275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88089-a03e-4459-b47f-9914367fcde7 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:31.837785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88089-a03e-4459-b47f-9914367fcde7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:31.837993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f88089-a03e-4459-b47f-9914367fcde7 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:31.839271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 655/1330] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:31.844611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268842-acd0-4867-bcb2-2158a168fbac None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:31.844999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268842-acd0-4867-bcb2-2158a168fbac None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:31.845171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268842-acd0-4867-bcb2-2158a168fbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:31.912444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-91268842-acd0-4867-bcb2-2158a168fbac None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:31.914373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-91268842-acd0-4867-bcb2-2158a168fbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.014262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 676/1331] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:32.065680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:32.065968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:32.066247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:32.067684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 656/1332] 10.222.0.71 () {54 vars in 964 bytes} [Fri May 27 03:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:32.073938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a197f-b16d-45b4-b182-ddd9f41cfb1e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:32.074232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a197f-b16d-45b4-b182-ddd9f41cfb1e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:32.074526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a197f-b16d-45b4-b182-ddd9f41cfb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:32.120620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:32.152216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bc9a197f-b16d-45b4-b182-ddd9f41cfb1e None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:32.153823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bc9a197f-b16d-45b4-b182-ddd9f41cfb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.229731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 677/1333] 10.222.0.71 () {58 vars in 1061 bytes} [Fri May 27 03:29:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:32.239822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:32.241402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.357138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adba553-6fb4-4342-99b2-4e0c0ca479e2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:32.442087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:32.442743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:32.443030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:32.443306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:32.444972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:32.474668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:32.566107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:32.567577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd25db71-2f8d-491c-8405-07f74e0d8ff2 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:32.587649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 657/1334] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:35.147244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:35.147802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:35.147802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:35.149128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 678/1335] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:35.154983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546037-3634-432f-94de-5e125501619c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:35.155411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546037-3634-432f-94de-5e125501619c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:35.155538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77546037-3634-432f-94de-5e125501619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:35.218681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-77546037-3634-432f-94de-5e125501619c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:35.219979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-77546037-3634-432f-94de-5e125501619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:35.292017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:35.314888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 658/1336] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:35.355258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:35.356821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:35.459756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee80d6-fd23-428d-8c55-ea21fe24ff88 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:35.488755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:35.534369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:35.535026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:35.535310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:35.535587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:35.537233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:35.644751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:35.646205 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea5243-e69b-4113-9f92-017d0a36ca7c service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:35.664531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 679/1337] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:38.859227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:38.859764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:38.859764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:38.861190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 659/1338] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:38.866325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d1d9-a4c2-4bc2-87ad-8e5475166ac1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:38.866795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d1d9-a4c2-4bc2-87ad-8e5475166ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:38.866899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2d1d9-a4c2-4bc2-87ad-8e5475166ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:38.930161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c9c2d1d9-a4c2-4bc2-87ad-8e5475166ac1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:38.931378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c9c2d1d9-a4c2-4bc2-87ad-8e5475166ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:38.940179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:39.028057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 680/1339] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:39.064005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:39.067033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:39.179076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3290fc-fad3-4979-8e71-6d7d244224d4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:39.192506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:39.198903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:39.198903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:39.198903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:39.198903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:39.300534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:39.302867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:39.304318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f575f68-2502-4193-9719-6c6c3cfb0963 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:39.325003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 660/1340] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:43.813880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:43.814419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:43.814501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:43.815876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 681/1341] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:43.821393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61603c-880f-4eeb-b45b-412c72395cf1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:43.821806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61603c-880f-4eeb-b45b-412c72395cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:43.821946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e61603c-880f-4eeb-b45b-412c72395cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:43.869492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3e61603c-880f-4eeb-b45b-412c72395cf1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:43.870694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3e61603c-880f-4eeb-b45b-412c72395cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:43.946717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 661/1342] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:43.986866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:43.988996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:44.011965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f96b9-6998-428e-b960-ae5ee4a3ae01 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:44.015526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:44.016163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:44.016445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:44.016720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:44.025653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:44.027061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb3b21-a43e-482b-ada1-aee504d60c48 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:44.036389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 682/1343] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:47.201908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:47.206009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:47.206009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:47.206009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 662/1344] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:47.209088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4af61-6dbe-4adf-9ab6-a83177606373 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:47.209504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4af61-6dbe-4adf-9ab6-a83177606373 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:47.209694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4af61-6dbe-4adf-9ab6-a83177606373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:47.238011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-77f4af61-6dbe-4adf-9ab6-a83177606373 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:47.239201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-77f4af61-6dbe-4adf-9ab6-a83177606373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:47.247526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 683/1345] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:47.284518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:47.286238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:47.300025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54091a3b-cf88-460b-a4c7-37f5b1220165 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:47.304701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:47.304701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:47.304701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:47.304981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:47.314471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:47.315968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756bde8-a9d6-4049-a48a-5694d1fad0c9 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:47.325529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 663/1346] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:52.113502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb98d-d2a3-42a2-aaa8-66bd37bf0aa4 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:52.114024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb98d-d2a3-42a2-aaa8-66bd37bf0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:52.114024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb98d-d2a3-42a2-aaa8-66bd37bf0aa4 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:52.115386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 684/1347] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:52.120743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e5f4-f6bc-4e48-a200-3a3d0e446573 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:52.121399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e5f4-f6bc-4e48-a200-3a3d0e446573 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:52.121399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794e5f4-f6bc-4e48-a200-3a3d0e446573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:52.139727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4794e5f4-f6bc-4e48-a200-3a3d0e446573 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:52.140927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4794e5f4-f6bc-4e48-a200-3a3d0e446573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:52.148890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 664/1348] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:29:52.186197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb98d-d2a3-42a2-aaa8-66bd37bf0aa4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:29:52.200619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb98d-d2a3-42a2-aaa8-66bd37bf0aa4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:29:52.204241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:29:52.204890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:52.205174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:52.205484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:52.216005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:29:52.217486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75729664-20ec-4be0-a6b4-504a413b9f6e service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:29:52.227633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 685/1349] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:29:57.641289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d33-b015-435d-beb3-cedb36ddbf61 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:57.641824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d33-b015-435d-beb3-cedb36ddbf61 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:57.641906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b90d33-b015-435d-beb3-cedb36ddbf61 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:57.643221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 665/1350] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:29:57.648133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9241c-317c-4c65-9e72-63278c9b83d9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:29:57.648908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9241c-317c-4c65-9e72-63278c9b83d9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:29:57.649477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9241c-317c-4c65-9e72-63278c9b83d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:29:57.720317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-51f9241c-317c-4c65-9e72-63278c9b83d9 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:29:57.721580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-51f9241c-317c-4c65-9e72-63278c9b83d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:29:57.761782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:29:57.798413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 686/1351] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:29:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:02.133739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=60 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:02.280647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74906-80b9-4524-9f09-8a4a2ec56857 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:02.281079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74906-80b9-4524-9f09-8a4a2ec56857 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:02.281210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a74906-80b9-4524-9f09-8a4a2ec56857 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:02.282803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 666/1352] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:02.287607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe8a2-a16e-49d1-9eca-21ce56967870 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:02.288853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe8a2-a16e-49d1-9eca-21ce56967870 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:02.289386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887fe8a2-a16e-49d1-9eca-21ce56967870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:02.309616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-887fe8a2-a16e-49d1-9eca-21ce56967870 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:02.310831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-887fe8a2-a16e-49d1-9eca-21ce56967870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:02.319961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 687/1353] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:30:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:03.783335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f43c0-bbdc-4965-9c3b-62ab00a66a30 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:03.783335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f43c0-bbdc-4965-9c3b-62ab00a66a30 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:03.783335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f43c0-bbdc-4965-9c3b-62ab00a66a30 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:03.783335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 667/1354] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb780-6298-4a34-88e3-50a7dae9e306 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb780-6298-4a34-88e3-50a7dae9e306 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276eb780-6298-4a34-88e3-50a7dae9e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-276eb780-6298-4a34-88e3-50a7dae9e306 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-276eb780-6298-4a34-88e3-50a7dae9e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:03.784681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 688/1355] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:30:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:07.774893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3704-f009-4a88-b556-47cb2bd916d4 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:07.775888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3704-f009-4a88-b556-47cb2bd916d4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:07.777177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae3704-f009-4a88-b556-47cb2bd916d4 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:07.779502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 668/1356] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:07.784508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffe34-9ff1-4b7a-befd-6fb3e1df6f6c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:07.785386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffe34-9ff1-4b7a-befd-6fb3e1df6f6c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:07.785974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ffe34-9ff1-4b7a-befd-6fb3e1df6f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:07.806729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a10ffe34-9ff1-4b7a-befd-6fb3e1df6f6c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:07.808653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a10ffe34-9ff1-4b7a-befd-6fb3e1df6f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:07.820219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 689/1357] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:07.876248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e5d0c-6dcf-48b1-882f-04432ca2068a None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:07.876774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e5d0c-6dcf-48b1-882f-04432ca2068a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:07.877293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e5d0c-6dcf-48b1-882f-04432ca2068a None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:07.878965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 669/1358] 10.222.0.71 () {54 vars in 961 bytes} [Fri May 27 03:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:07.892453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a4c-2ae7-4311-ad07-632e3160b71b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:07.893041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a4c-2ae7-4311-ad07-632e3160b71b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:07.893571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e7a4c-2ae7-4311-ad07-632e3160b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:07.945658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-6d8e7a4c-2ae7-4311-ad07-632e3160b71b None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:07.946974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6d8e7a4c-2ae7-4311-ad07-632e3160b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:08.038269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 690/1359] 10.222.0.71 () {58 vars in 1058 bytes} [Fri May 27 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:08.048698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e5d0c-6dcf-48b1-882f-04432ca2068a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:08.064226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e5d0c-6dcf-48b1-882f-04432ca2068a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:08.070398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:08.079359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:08.079359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:08.079359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:08.080995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:08.082724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd20ed-7b0a-4fb7-ac47-9b3353bf93d0 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:08.092926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 670/1360] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:30:10.568149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac660d-a893-46e7-b79b-da84aaaae11f None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:10.568712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac660d-a893-46e7-b79b-da84aaaae11f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:10.568712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac660d-a893-46e7-b79b-da84aaaae11f None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:10.570269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 691/1361] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:30:10.575363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39b4a-0860-447c-98e0-f139d9698057 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:10.575791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39b4a-0860-447c-98e0-f139d9698057 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:10.575902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39b4a-0860-447c-98e0-f139d9698057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:10.594993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-49a39b4a-0860-447c-98e0-f139d9698057 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:10.596111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-49a39b4a-0860-447c-98e0-f139d9698057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:10.603882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 671/1362] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:10.648677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac660d-a893-46e7-b79b-da84aaaae11f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:10.664012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beac660d-a893-46e7-b79b-da84aaaae11f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:10.675553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:10.676212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:10.676497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:10.676908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:10.687921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:10.689944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94827e0c-2899-4b91-b04a-341d4cc6c2d3 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:10.701105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 692/1363] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:13.433753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89182bb4-b2fd-4800-9b9c-f22d5c51eef7 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:13.433753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89182bb4-b2fd-4800-9b9c-f22d5c51eef7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:13.434399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89182bb4-b2fd-4800-9b9c-f22d5c51eef7 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:13.435839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 672/1364] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:13.441042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435fbf-e808-4df2-a9cc-b35a54b9087a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:13.441870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435fbf-e808-4df2-a9cc-b35a54b9087a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:13.442153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9435fbf-e808-4df2-a9cc-b35a54b9087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:13.460020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c9435fbf-e808-4df2-a9cc-b35a54b9087a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:13.461909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c9435fbf-e808-4df2-a9cc-b35a54b9087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:13.481515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 693/1365] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:13.521840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09ba4-dfc1-4ee2-b2eb-afa83a6e00ae None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:13.522121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09ba4-dfc1-4ee2-b2eb-afa83a6e00ae None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:13.522396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec09ba4-dfc1-4ee2-b2eb-afa83a6e00ae None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:13.524007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 673/1366] 10.222.0.71 () {54 vars in 961 bytes} [Fri May 27 03:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:13.531842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e75-1992-42cc-8e5a-d805b6c0b612 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:13.535645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e75-1992-42cc-8e5a-d805b6c0b612 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:13.535942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e75-1992-42cc-8e5a-d805b6c0b612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:13.554457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a59a4e75-1992-42cc-8e5a-d805b6c0b612 None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:13.555674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a59a4e75-1992-42cc-8e5a-d805b6c0b612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:13.565906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 694/1367] 10.222.0.71 () {58 vars in 1058 bytes} [Fri May 27 03:30:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:13.573855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec09ba4-dfc1-4ee2-b2eb-afa83a6e00ae None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:13.588799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec09ba4-dfc1-4ee2-b2eb-afa83a6e00ae None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:13.594198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:13.594826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:13.595112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:13.595396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:13.603298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:13.605491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee7d9-a300-40d0-8776-0f0c54f4879c service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:13.614986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 674/1368] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:16.071686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970d23d-3555-42e2-9873-b8dc062505ee None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.072264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970d23d-3555-42e2-9873-b8dc062505ee None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.072264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b970d23d-3555-42e2-9873-b8dc062505ee None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.073797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 695/1369] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:16.079430 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4bb12-2d86-4b46-a8c5-716c47e80edc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.079866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4bb12-2d86-4b46-a8c5-716c47e80edc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.079993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4bb12-2d86-4b46-a8c5-716c47e80edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.101298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ced4bb12-2d86-4b46-a8c5-716c47e80edc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:16.102752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ced4bb12-2d86-4b46-a8c5-716c47e80edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:16.113781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 675/1370] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:16.157001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970d23d-3555-42e2-9873-b8dc062505ee None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:16.172306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b970d23d-3555-42e2-9873-b8dc062505ee None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:16.178050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:16.178743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.179030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.179304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.189776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:16.191651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff2439-3e94-4400-ab1b-2b68893d2153 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:16.203736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 696/1371] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:16.212140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230316d-83e5-4872-a3d4-ff508496966c None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.212492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230316d-83e5-4872-a3d4-ff508496966c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.212776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230316d-83e5-4872-a3d4-ff508496966c None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.218827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 676/1372] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:16.224761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e460-279d-41d5-ae0c-eb054859fde4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.225048 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e460-279d-41d5-ae0c-eb054859fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.225390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1e460-279d-41d5-ae0c-eb054859fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.245566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f1f1e460-279d-41d5-ae0c-eb054859fde4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:16.247458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f1f1e460-279d-41d5-ae0c-eb054859fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:16.255950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 697/1373] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:16.541373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263979a-4934-42fa-ae50-3947524f4d09 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.542307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263979a-4934-42fa-ae50-3947524f4d09 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.542786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263979a-4934-42fa-ae50-3947524f4d09 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.544547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 677/1374] 10.222.0.71 () {54 vars in 963 bytes} [Fri May 27 03:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:16.550394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476f8-f616-43bc-b8ef-6bad2c247cc2 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.550835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476f8-f616-43bc-b8ef-6bad2c247cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.551252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4476f8-f616-43bc-b8ef-6bad2c247cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.582958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:16.612906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-dc4476f8-f616-43bc-b8ef-6bad2c247cc2 None None] MFA Rules not processed for user `5b23f15e3a064cd7b7cb6c100004a111`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:16.614313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dc4476f8-f616-43bc-b8ef-6bad2c247cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:16.686377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 698/1375] 10.222.0.71 () {58 vars in 1060 bytes} [Fri May 27 03:30:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:16.695502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263979a-4934-42fa-ae50-3947524f4d09 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:16.709493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0263979a-4934-42fa-ae50-3947524f4d09 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:16.714435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:16.715318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:16.715610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:16.715888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:16.725994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:16.727441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323eb99-ad45-46d7-ba4f-262815ff0181 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:16.738894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 678/1376] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:18.725965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864279d-7f8c-45c9-8891-df6ec77641f2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:18.726482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864279d-7f8c-45c9-8891-df6ec77641f2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:18.726565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864279d-7f8c-45c9-8891-df6ec77641f2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:18.727897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 699/1377] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:18.733620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820c55-7244-4bdf-9664-166dad43ea31 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:18.734079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820c55-7244-4bdf-9664-166dad43ea31 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:18.734162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2820c55-7244-4bdf-9664-166dad43ea31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:18.753812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b2820c55-7244-4bdf-9664-166dad43ea31 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:18.755037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b2820c55-7244-4bdf-9664-166dad43ea31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:18.763808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 679/1378] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:18.807410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864279d-7f8c-45c9-8891-df6ec77641f2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:18.822288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864279d-7f8c-45c9-8891-df6ec77641f2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:18.828742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:18.829420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:18.829709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:18.829984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:18.839144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:18.840723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34348cf6-064f-4e44-80a4-b8b954ef0b13 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:18.850984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 700/1379] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:21.248235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41097-2266-4edf-869d-04850c641a95 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:21.249109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41097-2266-4edf-869d-04850c641a95 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:21.249428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e41097-2266-4edf-869d-04850c641a95 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:21.250810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 680/1380] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:21.255980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325c26-f942-4e4f-aecc-751192aa61f7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:21.256426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325c26-f942-4e4f-aecc-751192aa61f7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:21.256544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325c26-f942-4e4f-aecc-751192aa61f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:21.275989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ea325c26-f942-4e4f-aecc-751192aa61f7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:21.277524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ea325c26-f942-4e4f-aecc-751192aa61f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:21.289739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 701/1381] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:21.329315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e41097-2266-4edf-869d-04850c641a95 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:21.345451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e41097-2266-4edf-869d-04850c641a95 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:21.351215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:21.352050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:21.352487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:21.352918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:21.361694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:21.363489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319737d-9991-4edf-84c3-aed1e264c609 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:21.374023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 681/1382] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:23.790738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd59b-fb56-433b-84b0-f4d0e9d99453 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:23.791830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd59b-fb56-433b-84b0-f4d0e9d99453 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:23.791830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820dd59b-fb56-433b-84b0-f4d0e9d99453 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:23.793188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 702/1383] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:23.798466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529649-3874-4e80-9f95-2ef9a7737323 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:23.798862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529649-3874-4e80-9f95-2ef9a7737323 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:23.799028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f529649-3874-4e80-9f95-2ef9a7737323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:23.818072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7f529649-3874-4e80-9f95-2ef9a7737323 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:23.819247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7f529649-3874-4e80-9f95-2ef9a7737323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:23.827316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 682/1384] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:23.869827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dd59b-fb56-433b-84b0-f4d0e9d99453 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:23.884799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820dd59b-fb56-433b-84b0-f4d0e9d99453 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:23.891204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:23.892091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:23.892587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:23.892961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:23.903284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:23.904858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f122d-9fa3-4306-860c-694e0d0974cb service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:23.915489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 703/1385] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:26.149421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c05fb-5e8b-4697-9f0f-e1bcdc3c8adb None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:26.149960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c05fb-5e8b-4697-9f0f-e1bcdc3c8adb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:26.150189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c05fb-5e8b-4697-9f0f-e1bcdc3c8adb None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:26.152006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 683/1386] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:26.157281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669538b-e3a9-4d78-bfee-996642f01bcf None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:26.157739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669538b-e3a9-4d78-bfee-996642f01bcf None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:26.157878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669538b-e3a9-4d78-bfee-996642f01bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:26.176881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c669538b-e3a9-4d78-bfee-996642f01bcf None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:26.178127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c669538b-e3a9-4d78-bfee-996642f01bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:26.187032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 704/1387] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:26.235221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c05fb-5e8b-4697-9f0f-e1bcdc3c8adb None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:26.250612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c05fb-5e8b-4697-9f0f-e1bcdc3c8adb None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:26.256257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:26.256907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:26.257199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:26.257508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:26.267148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:26.268740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a3b78-f028-432e-aee9-c72f490afe9e service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:26.278699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 684/1388] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:29.815596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22b32-b10d-434c-b72c-04b5a4b72670 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:29.816165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22b32-b10d-434c-b72c-04b5a4b72670 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:29.816374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a22b32-b10d-434c-b72c-04b5a4b72670 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:29.821292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 705/1389] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:29.824607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89873a5-c826-445c-ba3e-db26b6362d8a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:29.825304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89873a5-c826-445c-ba3e-db26b6362d8a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:29.825304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89873a5-c826-445c-ba3e-db26b6362d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:29.844905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c89873a5-c826-445c-ba3e-db26b6362d8a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:29.846074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c89873a5-c826-445c-ba3e-db26b6362d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:29.854629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 685/1390] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:29.901203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a22b32-b10d-434c-b72c-04b5a4b72670 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:29.924481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a22b32-b10d-434c-b72c-04b5a4b72670 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:29.933876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:29.934900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:29.935326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:29.935858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:29.949485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:29.952189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6dc06-a02d-4f26-b390-2c8d569c5227 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:29.967835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 706/1391] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:32.393084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b265-860e-4f9c-a995-f8e03d42c810 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.393723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b265-860e-4f9c-a995-f8e03d42c810 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.393723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333b265-860e-4f9c-a995-f8e03d42c810 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.395279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 686/1392] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:32.401651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bf12-4472-4f5b-97a5-df7c0bb22258 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.402109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bf12-4472-4f5b-97a5-df7c0bb22258 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.402109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7bf12-4472-4f5b-97a5-df7c0bb22258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.420625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b3c7bf12-4472-4f5b-97a5-df7c0bb22258 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:32.421865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b3c7bf12-4472-4f5b-97a5-df7c0bb22258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:32.429707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 707/1393] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:32.474961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b265-860e-4f9c-a995-f8e03d42c810 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:32.484111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=46 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:32.494770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333b265-860e-4f9c-a995-f8e03d42c810 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:32.497179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:32.497860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.498143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.498416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.506956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:32.508585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e941a5ba-f347-4d7e-9394-d5a807447376 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:32.519282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 687/1394] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:32.943339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337d0e-f46e-476e-bd7d-7a081da5fbd2 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.943701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337d0e-f46e-476e-bd7d-7a081da5fbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.943977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57337d0e-f46e-476e-bd7d-7a081da5fbd2 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.948215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 708/1395] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:32.951594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd83a-9675-43c5-9d92-fa15783e91c5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:32.952110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd83a-9675-43c5-9d92-fa15783e91c5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:32.952397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154bd83a-9675-43c5-9d92-fa15783e91c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:32.972477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-154bd83a-9675-43c5-9d92-fa15783e91c5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:32.973764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-154bd83a-9675-43c5-9d92-fa15783e91c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:32.983015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 688/1396] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:33.043487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a6b1-0e19-4526-91df-d7259cf35623 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.043838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a6b1-0e19-4526-91df-d7259cf35623 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.044049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992a6b1-0e19-4526-91df-d7259cf35623 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.045850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 709/1397] 10.222.0.71 () {54 vars in 962 bytes} [Fri May 27 03:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:33.051186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3eba-749f-4b0b-af41-b156136b28b4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.051476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3eba-749f-4b0b-af41-b156136b28b4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.051781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d3eba-749f-4b0b-af41-b156136b28b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.102376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b88d3eba-749f-4b0b-af41-b156136b28b4 None None] MFA Rules not processed for user `6ce376ecc47a48c1bac3a5231d09c91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:33.104257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b88d3eba-749f-4b0b-af41-b156136b28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:33.167655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 689/1398] 10.222.0.71 () {58 vars in 1059 bytes} [Fri May 27 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:33.175406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a6b1-0e19-4526-91df-d7259cf35623 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:33.187468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992a6b1-0e19-4526-91df-d7259cf35623 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:33.190995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:33.191648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.191928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.192205 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.202273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:33.203716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4c063-b72b-46c9-a365-ef2090e2dc46 service glance] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:33.214067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 710/1399] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:33.930209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70629e1-5be5-494e-95b4-f0d9cb4a6896 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:33.930761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70629e1-5be5-494e-95b4-f0d9cb4a6896 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:33.930761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70629e1-5be5-494e-95b4-f0d9cb4a6896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:33.981988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f70629e1-5be5-494e-95b4-f0d9cb4a6896 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:33.983092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f70629e1-5be5-494e-95b4-f0d9cb4a6896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:34.051549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 690/1400] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:30:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:34.093517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4afb-ba48-42a3-8507-fb94759365d1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:34.094003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4afb-ba48-42a3-8507-fb94759365d1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:34.094123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc4afb-ba48-42a3-8507-fb94759365d1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:34.095468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 711/1401] 10.222.0.71 () {54 vars in 942 bytes} [Fri May 27 03:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:34.101771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f230-a235-483f-8f38-4f56be6ce9c4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:34.102066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f230-a235-483f-8f38-4f56be6ce9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:34.102345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2f230-a235-483f-8f38-4f56be6ce9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:34.147767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:34.150613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0da2f230-a235-483f-8f38-4f56be6ce9c4 None None] MFA Rules not processed for user `fcd9230db6ae4c46b4cfb0e07a103949`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:34.151795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0da2f230-a235-483f-8f38-4f56be6ce9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:34.222166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 691/1402] 10.222.0.71 () {58 vars in 1039 bytes} [Fri May 27 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:34.232191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc4afb-ba48-42a3-8507-fb94759365d1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:34.246330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dc4afb-ba48-42a3-8507-fb94759365d1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:34.251191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:34.251868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:34.252154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:34.252427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:34.260619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:34.262229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cece7-d0a7-4515-b78f-32df8c8d90a6 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:34.270301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 712/1403] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:30:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 03:30:35.185221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d8ac-42f8-4481-9348-b3154772538a None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:35.185885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d8ac-42f8-4481-9348-b3154772538a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:35.185885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586d8ac-42f8-4481-9348-b3154772538a None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:35.189001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 692/1404] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:35.193770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b60f66-87b3-4c2c-9bc8-e02e4ec597b7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:35.194627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b60f66-87b3-4c2c-9bc8-e02e4ec597b7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:35.195114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b60f66-87b3-4c2c-9bc8-e02e4ec597b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:35.214577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-61b60f66-87b3-4c2c-9bc8-e02e4ec597b7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:35.221480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-61b60f66-87b3-4c2c-9bc8-e02e4ec597b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:35.224628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 713/1405] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:30:35.273762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d8ac-42f8-4481-9348-b3154772538a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:35.295022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586d8ac-42f8-4481-9348-b3154772538a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:35.300987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:35.301672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:35.301956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:35.302233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:35.314607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:35.317394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d90b7-4d73-4eb1-a525-bab847ffe0ef service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:35.331179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 693/1406] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:37.737185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e55c-7c98-43f0-9ecd-55e7ba43fba5 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:37.737764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e55c-7c98-43f0-9ecd-55e7ba43fba5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:37.737764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a03e55c-7c98-43f0-9ecd-55e7ba43fba5 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:37.739136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 714/1407] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:37.745508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ca7b-7b89-40e6-8963-6ed0bc53c491 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:37.745964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ca7b-7b89-40e6-8963-6ed0bc53c491 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:37.746064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ca7b-7b89-40e6-8963-6ed0bc53c491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:37.764235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-db45ca7b-7b89-40e6-8963-6ed0bc53c491 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:37.765469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-db45ca7b-7b89-40e6-8963-6ed0bc53c491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:37.773602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 694/1408] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:37.819407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03e55c-7c98-43f0-9ecd-55e7ba43fba5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:30:37.834489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a03e55c-7c98-43f0-9ecd-55e7ba43fba5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:30:37.842913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:30:37.843612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:37.843896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:37.844171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:37.854906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:30:37.856521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13eba9e-1996-41a0-8dbf-ea0e56078800 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:30:37.867643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 715/1409] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:30:47.759192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=39 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:47.864583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=79 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:30:59.143693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e4367-a7c6-407d-bfee-a6296ca87a4e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.144226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e4367-a7c6-407d-bfee-a6296ca87a4e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.144363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e4367-a7c6-407d-bfee-a6296ca87a4e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.145719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 695/1410] 10.222.0.71 () {54 vars in 918 bytes} [Fri May 27 03:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:59.151044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a065-9a4a-48b2-b517-bcc7ae3c4d63 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.151971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a065-9a4a-48b2-b517-bcc7ae3c4d63 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.152154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59a065-9a4a-48b2-b517-bcc7ae3c4d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.170350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fc59a065-9a4a-48b2-b517-bcc7ae3c4d63 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:59.171450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fc59a065-9a4a-48b2-b517-bcc7ae3c4d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:59.179705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 716/1411] 10.222.0.71 () {58 vars in 1015 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:30:59.193570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bdd1-3a42-4d2b-a6e1-bf078349084b None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.193869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bdd1-3a42-4d2b-a6e1-bf078349084b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.194152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3bdd1-3a42-4d2b-a6e1-bf078349084b None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.195668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 696/1412] 10.222.0.71 () {54 vars in 918 bytes} [Fri May 27 03:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:30:59.200407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7c68e-72a1-43f7-b864-448f8f11fa7b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:30:59.200696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7c68e-72a1-43f7-b864-448f8f11fa7b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:30:59.200975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7c68e-72a1-43f7-b864-448f8f11fa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:30:59.219192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-eef7c68e-72a1-43f7-b864-448f8f11fa7b None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:30:59.236774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eef7c68e-72a1-43f7-b864-448f8f11fa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:30:59.236774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 717/1413] 10.222.0.71 () {58 vars in 1015 bytes} [Fri May 27 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:01.941964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9855-5a40-4f6b-9758-eb0f2a02e2dd None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:01.942519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9855-5a40-4f6b-9758-eb0f2a02e2dd None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:01.942519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df9855-5a40-4f6b-9758-eb0f2a02e2dd None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:01.943892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:01.949800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95d98-5bee-4a8b-a0f7-724896855324 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:01.950244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95d98-5bee-4a8b-a0f7-724896855324 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:01.950362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd95d98-5bee-4a8b-a0f7-724896855324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:01.968667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4bd95d98-5bee-4a8b-a0f7-724896855324 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:01.969877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4bd95d98-5bee-4a8b-a0f7-724896855324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:01.977435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:02.019666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9855-5a40-4f6b-9758-eb0f2a02e2dd None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:02.034568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df9855-5a40-4f6b-9758-eb0f2a02e2dd None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:02.040004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:02.040641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:02.040921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:02.041232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:02.050558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:02.054122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff47b5-662b-4d8c-b628-62e9044db864 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:02.063491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 698/1416] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:03.033609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567490ed-71df-4630-88c9-c281a0d36963 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:03.034152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567490ed-71df-4630-88c9-c281a0d36963 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:03.034152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567490ed-71df-4630-88c9-c281a0d36963 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:03.035536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:03.040710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809065e-10ab-42f9-971a-fec7ba88030e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:03.041137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809065e-10ab-42f9-971a-fec7ba88030e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:03.041285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3809065e-10ab-42f9-971a-fec7ba88030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:03.060522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3809065e-10ab-42f9-971a-fec7ba88030e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:03.061725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3809065e-10ab-42f9-971a-fec7ba88030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:03.069371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:03.240181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567490ed-71df-4630-88c9-c281a0d36963 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:03.255699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567490ed-71df-4630-88c9-c281a0d36963 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:03.261626 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:03.262264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:03.262547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:03.262825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:03.270874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:03.272448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e232a1-bb17-495a-ae26-c1f0cc3afe3b service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:03.282666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 720/1419] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:04.203057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3b67-3012-409a-81be-e5513b1d2552 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:04.203670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3b67-3012-409a-81be-e5513b1d2552 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:04.203670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3b67-3012-409a-81be-e5513b1d2552 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:04.204968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:04.210188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305b85-fc0e-47dd-b0d5-5090a9f257ad None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:04.210847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305b85-fc0e-47dd-b0d5-5090a9f257ad None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:04.211003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e305b85-fc0e-47dd-b0d5-5090a9f257ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:04.229732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4e305b85-fc0e-47dd-b0d5-5090a9f257ad None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:04.230940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4e305b85-fc0e-47dd-b0d5-5090a9f257ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:04.238825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:04.393224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3b67-3012-409a-81be-e5513b1d2552 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:04.407961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3b67-3012-409a-81be-e5513b1d2552 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:04.413326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:04.413953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:04.414233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:04.414507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:04.423506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:04.429117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706711c-04a3-48ec-9a73-c9cbb65eacdf service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:04.435326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 701/1422] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:05.331774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56720a-6c06-438c-a3de-82b451f4a916 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:05.332292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56720a-6c06-438c-a3de-82b451f4a916 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:05.332292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd56720a-6c06-438c-a3de-82b451f4a916 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:05.333652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:05.339452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0a0f-51fb-4a72-87bd-4a7f02f40e29 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:05.339941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0a0f-51fb-4a72-87bd-4a7f02f40e29 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:05.340092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d0a0f-51fb-4a72-87bd-4a7f02f40e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:05.358767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a18d0a0f-51fb-4a72-87bd-4a7f02f40e29 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:05.359998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a18d0a0f-51fb-4a72-87bd-4a7f02f40e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:05.367911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:05.519925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56720a-6c06-438c-a3de-82b451f4a916 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:05.535196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd56720a-6c06-438c-a3de-82b451f4a916 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:05.540781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:05.541477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:05.541807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:05.542089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:05.550580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:05.552171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14453a69-aeef-4bfe-b75a-3c176105091f service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:05.561742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 723/1425] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:06.483760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c412a-e2f3-401f-a4d7-6a77f3df09f6 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:06.484328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c412a-e2f3-401f-a4d7-6a77f3df09f6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:06.484328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c412a-e2f3-401f-a4d7-6a77f3df09f6 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:06.485821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:06.490967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fcf5-1510-4901-8542-f71efa63ddb9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:06.491403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fcf5-1510-4901-8542-f71efa63ddb9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:06.491525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0fcf5-1510-4901-8542-f71efa63ddb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:06.509945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-23a0fcf5-1510-4901-8542-f71efa63ddb9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:06.511171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-23a0fcf5-1510-4901-8542-f71efa63ddb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:06.518850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:06.670862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c412a-e2f3-401f-a4d7-6a77f3df09f6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:06.685148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c412a-e2f3-401f-a4d7-6a77f3df09f6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:06.690502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:06.691133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:06.691416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:06.691691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:06.699821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:06.701423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dead777-41f5-42b2-a9e2-7e0aae52203d service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:06.711317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 704/1428] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:07.657236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e8a-793b-4d27-b395-53b324ab501c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:07.657735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e8a-793b-4d27-b395-53b324ab501c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:07.657833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f06e8a-793b-4d27-b395-53b324ab501c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:07.659190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:07.664311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f3ae-6df6-4e7e-816c-b25fa8c74a54 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:07.664742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f3ae-6df6-4e7e-816c-b25fa8c74a54 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:07.664875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f3ae-6df6-4e7e-816c-b25fa8c74a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:07.683170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6880f3ae-6df6-4e7e-816c-b25fa8c74a54 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:07.684354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6880f3ae-6df6-4e7e-816c-b25fa8c74a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:07.692026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:07.843068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06e8a-793b-4d27-b395-53b324ab501c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:07.857073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f06e8a-793b-4d27-b395-53b324ab501c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:07.862342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:07.862969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:07.863251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:07.863523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:07.873118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:07.874736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c44265-68d8-48f4-aabd-c95ce8473ef7 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:07.884100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 726/1431] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:08.816750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951435-25ad-4462-a7bc-f59004742f26 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:08.817318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951435-25ad-4462-a7bc-f59004742f26 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:08.817318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951435-25ad-4462-a7bc-f59004742f26 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:08.818722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:08.823921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7e74-77ec-4f9a-bf42-a0d6c7daac74 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:08.824334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7e74-77ec-4f9a-bf42-a0d6c7daac74 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:08.824510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c7e74-77ec-4f9a-bf42-a0d6c7daac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:08.842848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1c2c7e74-77ec-4f9a-bf42-a0d6c7daac74 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:08.844035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1c2c7e74-77ec-4f9a-bf42-a0d6c7daac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:08.851658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:09.002207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951435-25ad-4462-a7bc-f59004742f26 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:09.016474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951435-25ad-4462-a7bc-f59004742f26 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:09.021936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690b280-a749-4574-b572-98ea81990dec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:09.022572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b280-a749-4574-b572-98ea81990dec service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:09.022857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b280-a749-4574-b572-98ea81990dec service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:09.023136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690b280-a749-4574-b572-98ea81990dec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:09.031884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b280-a749-4574-b572-98ea81990dec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:09.033497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690b280-a749-4574-b572-98ea81990dec service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:09.043039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 707/1434] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:09.966013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269298-f526-4a0f-a018-07681d7c23f5 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:09.966590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269298-f526-4a0f-a018-07681d7c23f5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:09.966590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48269298-f526-4a0f-a018-07681d7c23f5 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:09.968256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:09.973147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1ef9-ec6a-4d9b-b730-02a5d10d72c3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:09.973708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1ef9-ec6a-4d9b-b730-02a5d10d72c3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:09.973788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf1ef9-ec6a-4d9b-b730-02a5d10d72c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:09.992510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ddaf1ef9-ec6a-4d9b-b730-02a5d10d72c3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:09.993761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ddaf1ef9-ec6a-4d9b-b730-02a5d10d72c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:10.002559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:10.152347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48269298-f526-4a0f-a018-07681d7c23f5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:10.167367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48269298-f526-4a0f-a018-07681d7c23f5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:10.172794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:10.173459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:10.173744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:10.174020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:10.183094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:10.184681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87deb54-1ccd-4ac1-b349-f9e15b6e4802 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:10.193978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 729/1437] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:11.112161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fcd5f-2996-4a48-9017-4ff9c3f050e6 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:11.112696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fcd5f-2996-4a48-9017-4ff9c3f050e6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:11.112696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fcd5f-2996-4a48-9017-4ff9c3f050e6 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:11.114047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:11.119235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084bfb-84e4-4ddc-a02f-db18af9f7463 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:11.120304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084bfb-84e4-4ddc-a02f-db18af9f7463 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:11.120450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af084bfb-84e4-4ddc-a02f-db18af9f7463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:11.138960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-af084bfb-84e4-4ddc-a02f-db18af9f7463 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:11.140149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-af084bfb-84e4-4ddc-a02f-db18af9f7463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:11.147852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:31:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:11.296731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fcd5f-2996-4a48-9017-4ff9c3f050e6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:11.311959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fcd5f-2996-4a48-9017-4ff9c3f050e6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:11.317252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:11.317999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:11.318312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:11.318576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:11.327819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:11.329436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71cec2-ac9d-4a6c-b6b7-ae41248fdaa7 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:11.339208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 710/1440] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:13.414610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285c6-3c87-4136-b6bb-d20b6fbad309 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:13.415149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285c6-3c87-4136-b6bb-d20b6fbad309 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:13.415149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6285c6-3c87-4136-b6bb-d20b6fbad309 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:13.416887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:13.422338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69cde-1eef-4439-801b-e751575fc54c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:13.422777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69cde-1eef-4439-801b-e751575fc54c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:13.422875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69cde-1eef-4439-801b-e751575fc54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:13.441134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f0c69cde-1eef-4439-801b-e751575fc54c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:13.442393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f0c69cde-1eef-4439-801b-e751575fc54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:13.450730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:13.489282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6285c6-3c87-4136-b6bb-d20b6fbad309 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:13.500497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6285c6-3c87-4136-b6bb-d20b6fbad309 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:13.504491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:13.505126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:13.505453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:13.505725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:13.515530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:13.517010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b3141-aa9e-4ef2-b8aa-5877c8f859dd service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:13.527032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 732/1443] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:15.940115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf001bb-408f-4249-8c14-80670f767639 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:15.940680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf001bb-408f-4249-8c14-80670f767639 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:15.940680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf001bb-408f-4249-8c14-80670f767639 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:15.942069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:15.947759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec43e0-1ef1-4c6c-9d88-bfb53dad1afc None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:15.948368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec43e0-1ef1-4c6c-9d88-bfb53dad1afc None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:15.948730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec43e0-1ef1-4c6c-9d88-bfb53dad1afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:15.967300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a1ec43e0-1ef1-4c6c-9d88-bfb53dad1afc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:15.968863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a1ec43e0-1ef1-4c6c-9d88-bfb53dad1afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:15.976600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:16.020433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf001bb-408f-4249-8c14-80670f767639 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:16.031683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf001bb-408f-4249-8c14-80670f767639 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:16.035132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:16.035758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:16.036038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:16.036310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:16.045088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:16.046540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca9fbf-4f38-47c9-a00b-541b833bdfd7 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:16.055676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 713/1446] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:31:18.683671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767171a-8c5e-416b-910c-457ed51965be None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:18.684308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767171a-8c5e-416b-910c-457ed51965be None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:18.684308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767171a-8c5e-416b-910c-457ed51965be None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:18.685651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:31:18.690874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f27fb-8d3b-4db1-8f90-a9ca25749570 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:18.691312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f27fb-8d3b-4db1-8f90-a9ca25749570 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:18.691443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f27fb-8d3b-4db1-8f90-a9ca25749570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:18.709763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-870f27fb-8d3b-4db1-8f90-a9ca25749570 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:18.711220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-870f27fb-8d3b-4db1-8f90-a9ca25749570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:18.719313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:18.757855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767171a-8c5e-416b-910c-457ed51965be None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:18.769189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767171a-8c5e-416b-910c-457ed51965be None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:18.772664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:18.773334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:18.773617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:18.773894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:18.782863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:18.784219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ce698-cfcc-443e-9bc5-025121780b9d service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:18.794292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 735/1449] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:21.116097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44447e1-d4b1-4ceb-958f-c630fa2684c5 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:21.116657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44447e1-d4b1-4ceb-958f-c630fa2684c5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:21.116657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44447e1-d4b1-4ceb-958f-c630fa2684c5 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.118171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:21.124057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93e41-5b8e-4797-addc-855a9fd7b84c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:21.124502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93e41-5b8e-4797-addc-855a9fd7b84c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:21.124629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d93e41-5b8e-4797-addc-855a9fd7b84c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.142691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a7d93e41-5b8e-4797-addc-855a9fd7b84c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:21.143868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a7d93e41-5b8e-4797-addc-855a9fd7b84c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:21.151661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:21.191228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44447e1-d4b1-4ceb-958f-c630fa2684c5 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:21.202123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44447e1-d4b1-4ceb-958f-c630fa2684c5 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:21.205571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:21.206196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:21.206477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:21.206753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:21.216175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:21.221710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa4fc6-0393-499c-b3db-0267de286f9b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:21.226887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 716/1452] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:23.548830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba193e-4e9b-4fa0-ba15-ae6e07388559 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:23.549375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba193e-4e9b-4fa0-ba15-ae6e07388559 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:23.549484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba193e-4e9b-4fa0-ba15-ae6e07388559 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:23.550896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:23.556294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37d2-922a-4ded-ba4e-812a66057f35 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:23.556852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37d2-922a-4ded-ba4e-812a66057f35 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:23.556852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96e37d2-922a-4ded-ba4e-812a66057f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:23.575138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b96e37d2-922a-4ded-ba4e-812a66057f35 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:23.576330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b96e37d2-922a-4ded-ba4e-812a66057f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:23.584620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:23.631117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba193e-4e9b-4fa0-ba15-ae6e07388559 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:23.642438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba193e-4e9b-4fa0-ba15-ae6e07388559 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:23.645911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:23.646540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:23.646823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:23.647097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:23.656451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:23.657906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3d46c-a2aa-4dfd-9bc0-02dbb71b0a73 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:23.667097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 738/1455] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:25.917513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ba5-1a99-4cc3-b763-c62544d884eb None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.918075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ba5-1a99-4cc3-b763-c62544d884eb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.918075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3ba5-1a99-4cc3-b763-c62544d884eb None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.919428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:25.924752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd646-6835-403c-a3fb-d28cccb223d1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:25.925195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd646-6835-403c-a3fb-d28cccb223d1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:25.925353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cd646-6835-403c-a3fb-d28cccb223d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:25.944216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-752cd646-6835-403c-a3fb-d28cccb223d1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:25.945449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-752cd646-6835-403c-a3fb-d28cccb223d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:25.953446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:25.991819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3ba5-1a99-4cc3-b763-c62544d884eb None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:26.003169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3ba5-1a99-4cc3-b763-c62544d884eb None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:26.006743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:26.007370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:26.007651 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:26.007926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:26.016618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:26.018061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b101541-e5fd-4640-a8a8-14f8a52f82cd service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:26.027176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 719/1458] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:28.271126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34128-83f6-48cf-a590-2d046d8682ab None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:28.271672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34128-83f6-48cf-a590-2d046d8682ab None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:28.271672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c34128-83f6-48cf-a590-2d046d8682ab None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:28.272965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:28.278388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8eca-ab1c-4c92-af4a-0f35d3b08bf7 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:28.278805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8eca-ab1c-4c92-af4a-0f35d3b08bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:28.278982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb8eca-ab1c-4c92-af4a-0f35d3b08bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:28.285035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=70 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:28.297563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-03fb8eca-ab1c-4c92-af4a-0f35d3b08bf7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:28.298813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-03fb8eca-ab1c-4c92-af4a-0f35d3b08bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:28.307217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:28.344502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34128-83f6-48cf-a590-2d046d8682ab None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:28.349869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=73 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:28.356281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c34128-83f6-48cf-a590-2d046d8682ab None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:28.360929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:28.360929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:28.360929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:28.361226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:28.370023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:28.371441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0aefa1-2856-468a-bc0f-87e46debd8b2 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:28.381086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 741/1461] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:30.619905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c00cd-9bd5-49e0-af4e-863ca56cc04e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:30.620442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c00cd-9bd5-49e0-af4e-863ca56cc04e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:30.620538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c00cd-9bd5-49e0-af4e-863ca56cc04e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:30.621897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:30.627281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cce6-23d5-41d9-aa2b-d4d99d76891a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:30.627689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cce6-23d5-41d9-aa2b-d4d99d76891a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:30.627844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565cce6-23d5-41d9-aa2b-d4d99d76891a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:30.771277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2565cce6-23d5-41d9-aa2b-d4d99d76891a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:30.772538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2565cce6-23d5-41d9-aa2b-d4d99d76891a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:30.780507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:30.817243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c00cd-9bd5-49e0-af4e-863ca56cc04e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:30.828687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c00cd-9bd5-49e0-af4e-863ca56cc04e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:30.832328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:30.832922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:30.833209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:30.833513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:30.843109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:30.844569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f58a9-dd9a-40af-981c-6c5ef06b2b0c service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:30.854301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 722/1464] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:33.090166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e95b-b118-425f-80b4-693297c683d0 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:33.090757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e95b-b118-425f-80b4-693297c683d0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:33.090757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e95b-b118-425f-80b4-693297c683d0 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:33.092084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:33.097513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f082c-9a64-4914-802f-80d8515cc1d9 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:33.097948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f082c-9a64-4914-802f-80d8515cc1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:33.098091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f082c-9a64-4914-802f-80d8515cc1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:33.116864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a46f082c-9a64-4914-802f-80d8515cc1d9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:33.118088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a46f082c-9a64-4914-802f-80d8515cc1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:33.126384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:33.162284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e95b-b118-425f-80b4-693297c683d0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:33.173568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e95b-b118-425f-80b4-693297c683d0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:33.176948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:33.177606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:33.177886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:33.178156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:33.187548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:33.188986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb960e60-988b-4978-925b-114e2dc70453 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:33.198815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 744/1467] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:35.406892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29329-6414-4f42-b396-bb4389c1aaa7 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:35.407445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29329-6414-4f42-b396-bb4389c1aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:35.407445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d29329-6414-4f42-b396-bb4389c1aaa7 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:35.408814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:31:35.414207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65b99-eaf6-47d4-b8bb-2f661bda409f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:35.414662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65b99-eaf6-47d4-b8bb-2f661bda409f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:35.414769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad65b99-eaf6-47d4-b8bb-2f661bda409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:35.432579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fad65b99-eaf6-47d4-b8bb-2f661bda409f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:31:35.433778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fad65b99-eaf6-47d4-b8bb-2f661bda409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:31:35.441303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:31:35.478271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29329-6414-4f42-b396-bb4389c1aaa7 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:31:35.489163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d29329-6414-4f42-b396-bb4389c1aaa7 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:31:35.492675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:31:35.493420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:31:35.493734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:31:35.494013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:31:35.503058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:31:35.504515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462bf599-8391-42b2-bc75-3b43373659a9 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:31:35.514605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 725/1470] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:31:45.427967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=17 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:31:45.510413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=17 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:08.944338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0669441-b75b-43a3-8691-9c255628fe87 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:08.945145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0669441-b75b-43a3-8691-9c255628fe87 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:08.945145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0669441-b75b-43a3-8691-9c255628fe87 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:08.946473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 746/1471] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:08.951755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75acb9-e2fb-4f98-9a57-f32641ed1714 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:08.952202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75acb9-e2fb-4f98-9a57-f32641ed1714 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:08.952307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75acb9-e2fb-4f98-9a57-f32641ed1714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:08.970478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2b75acb9-e2fb-4f98-9a57-f32641ed1714 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:08.971671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2b75acb9-e2fb-4f98-9a57-f32641ed1714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:08.980090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 726/1472] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:09.026214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c075c7-8210-4939-b41f-af04ab3b51ff None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:09.026533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c075c7-8210-4939-b41f-af04ab3b51ff None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:09.026837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c075c7-8210-4939-b41f-af04ab3b51ff None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:09.028180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 747/1473] 10.222.0.71 () {54 vars in 962 bytes} [Fri May 27 03:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:09.033140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845bb-748a-4ef2-8938-c86a407ef3c5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:09.033469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845bb-748a-4ef2-8938-c86a407ef3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:09.033748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055845bb-748a-4ef2-8938-c86a407ef3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:09.052048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-055845bb-748a-4ef2-8938-c86a407ef3c5 None None] MFA Rules not processed for user `6ce376ecc47a48c1bac3a5231d09c91c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:09.053231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-055845bb-748a-4ef2-8938-c86a407ef3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:09.059617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 727/1474] 10.222.0.71 () {58 vars in 1059 bytes} [Fri May 27 03:32:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:09.066797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c075c7-8210-4939-b41f-af04ab3b51ff None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:09.077113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c075c7-8210-4939-b41f-af04ab3b51ff None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:09.080599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:09.081217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:09.081529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:09.081806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:09.091052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:09.092446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46d406-1cdb-4031-9d7c-ef4f5e7761e2 service glance] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:09.102367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 748/1475] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:11.386869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b564-6250-4398-98f3-8c2b7664534d None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:11.387453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b564-6250-4398-98f3-8c2b7664534d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:11.387453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea43b564-6250-4398-98f3-8c2b7664534d None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:11.388777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 728/1476] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:11.393909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029c3-4bac-4e9d-a02f-d22cc2345a18 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:11.394300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029c3-4bac-4e9d-a02f-d22cc2345a18 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:11.394464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db029c3-4bac-4e9d-a02f-d22cc2345a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:11.412260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9db029c3-4bac-4e9d-a02f-d22cc2345a18 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:11.414190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9db029c3-4bac-4e9d-a02f-d22cc2345a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:11.421861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 749/1477] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:11.445558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43b564-6250-4398-98f3-8c2b7664534d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:11.457718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea43b564-6250-4398-98f3-8c2b7664534d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:11.462952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:11.463598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:11.463880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:11.464171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:11.464910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:11.466741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:32:11.466741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:32:11.466741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:32:11.467910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9a2d5-8ff8-4021-a145-d50c3d544ed0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:11.486932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 729/1478] 10.222.0.71 () {56 vars in 1108 bytes} [Fri May 27 03:32:11 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:32:13.718209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b4d0-b491-4847-bf6c-360e39c91c3d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:13.718755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b4d0-b491-4847-bf6c-360e39c91c3d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:13.718755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99b4d0-b491-4847-bf6c-360e39c91c3d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:13.720120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 750/1479] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:13.725994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cc24-e618-42ce-b37c-a608e2b19652 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:13.726644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cc24-e618-42ce-b37c-a608e2b19652 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:13.726815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f9cc24-e618-42ce-b37c-a608e2b19652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:13.745504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-24f9cc24-e618-42ce-b37c-a608e2b19652 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:13.746706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-24f9cc24-e618-42ce-b37c-a608e2b19652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:13.754356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 730/1480] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:13.797382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b4d0-b491-4847-bf6c-360e39c91c3d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:13.811830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99b4d0-b491-4847-bf6c-360e39c91c3d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:13.817140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:13.817813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:13.818093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:13.818364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:13.826765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:13.828438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8389529-f503-416f-81aa-7895c2f8273b service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:13.838543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 751/1481] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:16.208170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e39b-1397-44f4-9505-41b7fd681850 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:16.208742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e39b-1397-44f4-9505-41b7fd681850 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:16.208742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d5e39b-1397-44f4-9505-41b7fd681850 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:16.210717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 731/1482] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:16.215867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778465f-2b1d-4bee-91fd-1e8f0298361a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:16.216264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778465f-2b1d-4bee-91fd-1e8f0298361a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:16.216423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778465f-2b1d-4bee-91fd-1e8f0298361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:16.234169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4778465f-2b1d-4bee-91fd-1e8f0298361a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:16.240023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4778465f-2b1d-4bee-91fd-1e8f0298361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:16.243937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 752/1483] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:16.279058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e39b-1397-44f4-9505-41b7fd681850 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:16.290094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d5e39b-1397-44f4-9505-41b7fd681850 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:16.293544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:16.294178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:16.294457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:16.294731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:16.304187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:16.305645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8c87b-e73b-4a6e-933c-d15480188fcc service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:16.314960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 732/1484] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:18.560107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8c33-6524-4930-96ac-29312cf9da4f None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:18.560636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8c33-6524-4930-96ac-29312cf9da4f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:18.560636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec8c33-6524-4930-96ac-29312cf9da4f None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:18.562056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 753/1485] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:18.567278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dff9-edc6-488e-8b12-1e9c6d3ce73a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:18.567724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dff9-edc6-488e-8b12-1e9c6d3ce73a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:18.567869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7dff9-edc6-488e-8b12-1e9c6d3ce73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:18.586365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e4f7dff9-edc6-488e-8b12-1e9c6d3ce73a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:18.587593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e4f7dff9-edc6-488e-8b12-1e9c6d3ce73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:18.595522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 733/1486] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:18.632865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8c33-6524-4930-96ac-29312cf9da4f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:18.643305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec8c33-6524-4930-96ac-29312cf9da4f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:18.646705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:18.647836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:18.648123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:18.648372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:18.657033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:18.658552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8176e-5c1d-48e6-ad04-6c460d175341 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:18.668312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 754/1487] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:20.980944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768faf-2803-403e-9a3f-e819b1885bbe None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:20.981487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768faf-2803-403e-9a3f-e819b1885bbe None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:20.981596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2768faf-2803-403e-9a3f-e819b1885bbe None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:20.982906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 734/1488] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:20.988093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a54-bc14-445c-af7e-faea0157a122 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:20.988530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a54-bc14-445c-af7e-faea0157a122 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:20.988647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c97a54-bc14-445c-af7e-faea0157a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:21.006126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-32c97a54-bc14-445c-af7e-faea0157a122 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:21.007451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-32c97a54-bc14-445c-af7e-faea0157a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:21.015113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 755/1489] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:21.055816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2768faf-2803-403e-9a3f-e819b1885bbe None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:21.066391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2768faf-2803-403e-9a3f-e819b1885bbe None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:21.069910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:21.070538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:21.070819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:21.071090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:21.080300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:21.081795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abdfaa-c9cd-4b44-b7af-c6790d2f6088 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:21.092070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 735/1490] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:23.766390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1170-688d-427c-8232-57a3b712d7f8 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:23.766966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1170-688d-427c-8232-57a3b712d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:23.767295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1170-688d-427c-8232-57a3b712d7f8 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:23.768812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 756/1491] 10.222.0.71 () {54 vars in 926 bytes} [Fri May 27 03:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:32:23.774577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8825f-ab39-46b5-9885-23ed20d8f5ef None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:23.775000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8825f-ab39-46b5-9885-23ed20d8f5ef None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:23.775147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8825f-ab39-46b5-9885-23ed20d8f5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:23.793421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-78d8825f-ab39-46b5-9885-23ed20d8f5ef None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:32:23.794619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-78d8825f-ab39-46b5-9885-23ed20d8f5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:32:23.802817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 736/1492] 10.222.0.71 () {58 vars in 1023 bytes} [Fri May 27 03:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:32:23.854499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1170-688d-427c-8232-57a3b712d7f8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:32:23.865165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1170-688d-427c-8232-57a3b712d7f8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:32:23.869153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:32:23.869829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:32:23.870139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:32:23.870419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:32:23.879325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:32:23.880736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebe0f3-9afc-40c3-8251-58cab2e3a822 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:32:23.890286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 757/1493] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:32:33.787391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=33 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:32:33.886125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=33 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:14.461419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.462002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.462002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.480290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:14.481515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:14.489992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 737/1494] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:14.499050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.499576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.499576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.517679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:14.518878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:14.527220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 758/1495] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:34:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:14.531757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.541991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e80e17-74b3-4c6c-a5d0-46b26b71bb2f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.546446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.547097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.547380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.547654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.548371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:34:14.548677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.549800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.549800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:34:14.549800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:34:14.551313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:14.562777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 738/1496] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:34:14.571264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.580208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1670122-1b52-4927-84fd-595d7ac0db74 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.585057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.585730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.586012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.586316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.587000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.588809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.588809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:34:14.588809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:34:14.590012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:14.697181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 759/1497] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:34:14 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:14.701390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.712026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5b390-6193-4021-b2a3-792054829ab6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.768163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.768829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.769113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.770024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.770717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.771772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.771772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:34:14.771772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:34:14.772969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:14.853015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 739/1498] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:34:14 2022] POST /identity/v3/users => generated 290 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:34:14.857014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.867645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bb2d08-ebb5-41e7-9113-adcd0e14b66c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.872112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.872775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.873059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.873374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.874181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.875135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.875135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:34:14.875135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:34:14.876016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:14.889461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 760/1499] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:14.893620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.903955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad8c61-e6cc-4465-9fa5-60ee3cf51465 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.908388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.909035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.909350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.909627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.911020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.912019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.912019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:34:14.912019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:34:14.912892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1878ff-7b32-4f5f-b05f-3c621a76eea1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:14.925839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 740/1500] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:34:14.930076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:14.940152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1e37-0f3c-438e-8ba7-2b8b54276a74 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:14.944727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:14.945642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:14.945935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:14.946216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] PATH_INFO: `/v3/projects/d913a6ed983f4c5aacb60d38732837b0/users/c24828ec620b4269880eec6cc3ae261f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:14.960949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d913a6ed983f4c5aacb60d38732837b0, user_id=c24828ec620b4269880eec6cc3ae261f, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:14.962005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:14.962005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:34:14.962005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:34:14.963975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925037f6-eb83-4cad-a64a-998a5bea1584 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:15.047699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 761/1501] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:34:14 2022] PUT /identity/v3/projects/d913a6ed983f4c5aacb60d38732837b0/users/c24828ec620b4269880eec6cc3ae261f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:15.059027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ab9f-f260-46dd-96b6-c07ddf90a39a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.059319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ab9f-f260-46dd-96b6-c07ddf90a39a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.059604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94ab9f-f260-46dd-96b6-c07ddf90a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.086937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4f94ab9f-f260-46dd-96b6-c07ddf90a39a None None] MFA Rules not processed for user `c24828ec620b4269880eec6cc3ae261f`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:15.088196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4f94ab9f-f260-46dd-96b6-c07ddf90a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:15.155037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 741/1502] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:15.169105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e0d6-a0a4-4e86-ac12-330317c19dc1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.169447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e0d6-a0a4-4e86-ac12-330317c19dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.169727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e0d6-a0a4-4e86-ac12-330317c19dc1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.171096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 762/1503] 10.222.0.71 () {54 vars in 963 bytes} [Fri May 27 03:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:34:15.176208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba40c-06bc-4596-b470-7371de40f51e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.176502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba40c-06bc-4596-b470-7371de40f51e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.176783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ba40c-06bc-4596-b470-7371de40f51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.195261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-182ba40c-06bc-4596-b470-7371de40f51e None None] MFA Rules not processed for user `5b23f15e3a064cd7b7cb6c100004a111`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:15.196451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-182ba40c-06bc-4596-b470-7371de40f51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:15.239726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:15.246882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 742/1504] 10.222.0.71 () {58 vars in 1060 bytes} [Fri May 27 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:15.360772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9e0d6-a0a4-4e86-ac12-330317c19dc1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:15.371357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9e0d6-a0a4-4e86-ac12-330317c19dc1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:15.374773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:15.375395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.375674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.375945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.385449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:15.386897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:15.396514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 763/1505] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:34:15.439242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66c20-ed0a-48c4-9cc8-715d1c272b23 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.439550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66c20-ed0a-48c4-9cc8-715d1c272b23 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.439842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b66c20-ed0a-48c4-9cc8-715d1c272b23 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.441735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 743/1506] 10.222.0.71 () {52 vars in 829 bytes} [Fri May 27 03:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:34:15.445577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:15.507813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90d2a5-d004-4130-9e67-acc972f56ca0 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:15.512362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:15.513230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.513545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.513820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] PATH_INFO: `/v3/users/c24828ec620b4269880eec6cc3ae261f` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.514986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c24828ec620b4269880eec6cc3ae261f)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:15.515997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:15.515997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:34:15.515997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:34:15.517182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:15.726957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c24828ec620b4269880eec6cc3ae261f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:15.727639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c24828ec620b4269880eec6cc3ae261f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:15.746063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c24828ec620b4269880eec6cc3ae261f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:15.818273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c24828ec620b4269880eec6cc3ae261f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:15.818922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c24828ec620b4269880eec6cc3ae261f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:15.827820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:15.838363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 764/1507] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:34:15 2022] DELETE /identity/v3/users/c24828ec620b4269880eec6cc3ae261f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:15.842956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.843436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.843545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:15.861275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:34:15.862540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:15.921742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 744/1508] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:34:15.932475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:15.933891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:15.991238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec00c5b-1244-4a78-986a-29e92bf0e229 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:15.994727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:15.995368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:15.995655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:15.995928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:16.004787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:16.006244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1910c8-e094-4ff6-a905-57e15fda53b5 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:16.015560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 765/1509] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:34:16.475906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:34:16.477417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:34:16.489731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb2431-e2bc-46f2-b8c6-67b8d3d64847 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:34:16.494565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:34:16.495509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:34:16.495721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:34:16.495998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] PATH_INFO: `/v3/projects/d913a6ed983f4c5aacb60d38732837b0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:34:16.497242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d913a6ed983f4c5aacb60d38732837b0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:34:16.498421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:34:16.498421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:34:16.498421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:34:16.499701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:34:16.636239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd913a6ed983f4c5aacb60d38732837b0', 'request_id': 'req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:16.650709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd913a6ed983f4c5aacb60d38732837b0', 'request_id': 'req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:16.656819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd913a6ed983f4c5aacb60d38732837b0', 'request_id': 'req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:16.744572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] The token cache is being invalidate because project d913a6ed983f4c5aacb60d38732837b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:34:16.744988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:16.745957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ca3d2cb9-d3f8-4ff8-943b-c0daf4e9a8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:34:16.747794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 745/1510] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:34:16 2022] DELETE /identity/v3/projects/d913a6ed983f4c5aacb60d38732837b0 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:34:26.011418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=29 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:34:26.741064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:02.729195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:02.729818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:02.729818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:02.731171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:02.736346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61537-482a-4567-a430-bc5784620b75 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:02.736824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61537-482a-4567-a430-bc5784620b75 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:02.736928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61537-482a-4567-a430-bc5784620b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:02.755315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-27b61537-482a-4567-a430-bc5784620b75 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:02.756514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-27b61537-482a-4567-a430-bc5784620b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:02.816530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:02.989799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:02.996128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:03.067301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fa0e6-7dc8-4c50-b654-a1953b80306d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:03.072486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:03.073127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:03.073437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:03.073713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:03.082335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:03.084153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f067785-4780-4903-9fde-0305b75e0122 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:03.093405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 767/1513] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:03.968241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b8e-cf8e-4d56-896f-b5c4c565a68f None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:03.968832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b8e-cf8e-4d56-896f-b5c4c565a68f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:03.968832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f86b8e-cf8e-4d56-896f-b5c4c565a68f None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:03.970223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:03.975315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021350a-5f28-40c0-9aba-50e3889b6a5c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:03.975780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021350a-5f28-40c0-9aba-50e3889b6a5c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:03.975895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021350a-5f28-40c0-9aba-50e3889b6a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:03.994375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9021350a-5f28-40c0-9aba-50e3889b6a5c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:03.995561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9021350a-5f28-40c0-9aba-50e3889b6a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:04.004957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:04.166497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86b8e-cf8e-4d56-896f-b5c4c565a68f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:04.181870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f86b8e-cf8e-4d56-896f-b5c4c565a68f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:04.187428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:04.188100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:04.188387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:04.188668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:04.196691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:04.198357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fd425-ec2f-4e60-a43e-994da95cd9ab service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:04.208246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 748/1516] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:04.310778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4cba-2423-4523-9644-cb16a9f48b0a None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:04.311180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4cba-2423-4523-9644-cb16a9f48b0a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:04.311473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b4cba-2423-4523-9644-cb16a9f48b0a None None] PATH_INFO: `/v3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:04.312793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 769/1517] 10.222.0.72 () {54 vars in 925 bytes} [Fri May 27 03:36:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:36:04.319014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab4e7-5ba4-43c7-a0df-b0b897cd51a1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:04.319300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab4e7-5ba4-43c7-a0df-b0b897cd51a1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:04.319574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ab4e7-5ba4-43c7-a0df-b0b897cd51a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:04.338436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7f8ab4e7-5ba4-43c7-a0df-b0b897cd51a1 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:04.339672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7f8ab4e7-5ba4-43c7-a0df-b0b897cd51a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:04.410318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 749/1518] 10.222.0.72 () {58 vars in 1015 bytes} [Fri May 27 03:36:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:08.574100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91146-f279-437f-acc5-c8a254ff8de1 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:08.574621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91146-f279-437f-acc5-c8a254ff8de1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:08.574621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a91146-f279-437f-acc5-c8a254ff8de1 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:08.576055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 770/1519] 10.222.0.71 () {54 vars in 960 bytes} [Fri May 27 03:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:08.580938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc87e9-ee2d-4301-b25d-8cd5b158d105 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:08.581510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc87e9-ee2d-4301-b25d-8cd5b158d105 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:08.581510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc87e9-ee2d-4301-b25d-8cd5b158d105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:08.599896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-30dc87e9-ee2d-4301-b25d-8cd5b158d105 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:08.601091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-30dc87e9-ee2d-4301-b25d-8cd5b158d105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:08.610154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 750/1520] 10.222.0.71 () {58 vars in 1057 bytes} [Fri May 27 03:36:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:08.617461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91146-f279-437f-acc5-c8a254ff8de1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:08.630763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a91146-f279-437f-acc5-c8a254ff8de1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:08.635646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:08.636273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:08.636552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:08.636824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:08.644987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:08.646573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447219e4-7894-4020-8d24-0b46be35840d service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:08.656475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 771/1521] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:15.511015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1eb6-caba-4669-8f41-5b79fd78e802 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:15.511581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1eb6-caba-4669-8f41-5b79fd78e802 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:15.511581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c1eb6-caba-4669-8f41-5b79fd78e802 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:15.512968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:15.518008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b5b4-ef0a-4732-a4b1-8dcc229219d3 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:15.518422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b5b4-ef0a-4732-a4b1-8dcc229219d3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:15.518635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b5b4-ef0a-4732-a4b1-8dcc229219d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:15.536787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4ed9b5b4-ef0a-4732-a4b1-8dcc229219d3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:15.538028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4ed9b5b4-ef0a-4732-a4b1-8dcc229219d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:15.546371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:15.701970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c1eb6-caba-4669-8f41-5b79fd78e802 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:15.716863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c1eb6-caba-4669-8f41-5b79fd78e802 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:15.723061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:15.723696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:15.723984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:15.724260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:15.732372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:15.734044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74378ad3-9d11-415a-a446-ef4d5530e460 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:15.743576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 752/1524] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:16.606885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf83a-43df-4484-afea-26634577b300 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.607443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf83a-43df-4484-afea-26634577b300 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.607443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedf83a-43df-4484-afea-26634577b300 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.609612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 03:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:16.614630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b21f0-833b-41d4-9c1e-3f49b1fe6b71 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.615079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b21f0-833b-41d4-9c1e-3f49b1fe6b71 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.615191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b21f0-833b-41d4-9c1e-3f49b1fe6b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.632749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ed6b21f0-833b-41d4-9c1e-3f49b1fe6b71 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:16.633967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ed6b21f0-833b-41d4-9c1e-3f49b1fe6b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:16.641747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 03:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:16.791321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf83a-43df-4484-afea-26634577b300 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:16.805866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedf83a-43df-4484-afea-26634577b300 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:16.811166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:16.811930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:16.812217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:16.812498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:16.820655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:16.822254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde52aa9-0ae9-40ad-a837-834b3d364578 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:16.838675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 774/1527] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:20.854551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:20.855077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:20.855077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:20.856479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:20.862744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc176e-9716-4e82-be06-1184b47a9cff None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:20.863170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc176e-9716-4e82-be06-1184b47a9cff None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:20.863315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc176e-9716-4e82-be06-1184b47a9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:20.882092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-49cc176e-9716-4e82-be06-1184b47a9cff None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:20.883294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-49cc176e-9716-4e82-be06-1184b47a9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:20.891503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:20.929131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:20.930869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:20.987670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c6a69-232d-47eb-b75c-970c167a28b2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:20.991221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:20.991861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:20.992145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:20.992422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:21.002095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:21.003516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa65df-2632-4ed1-a686-13b5a733428a service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:21.008394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:21.012987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 755/1530] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:23.185051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412174c-a848-41bb-b5d6-5b6bfde0a76c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.185628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412174c-a848-41bb-b5d6-5b6bfde0a76c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.185628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412174c-a848-41bb-b5d6-5b6bfde0a76c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.187544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:23.192850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489f54-b3c4-4758-8b91-fae8e4aa1b9c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.193298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489f54-b3c4-4758-8b91-fae8e4aa1b9c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.193451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55489f54-b3c4-4758-8b91-fae8e4aa1b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.212264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-55489f54-b3c4-4758-8b91-fae8e4aa1b9c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:23.213493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-55489f54-b3c4-4758-8b91-fae8e4aa1b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:23.222108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:23.256814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412174c-a848-41bb-b5d6-5b6bfde0a76c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:23.268681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412174c-a848-41bb-b5d6-5b6bfde0a76c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:23.272216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:23.272855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:23.273173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:23.273487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:23.283309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:23.284763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7a3a-cb33-4de9-9d30-b9baa0e08197 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:23.294133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 777/1533] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:27.119547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:27.120030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:27.120130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:27.121552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:27.127006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401a06c-b981-473c-b3ed-940c55935140 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:27.127446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401a06c-b981-473c-b3ed-940c55935140 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:27.127573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401a06c-b981-473c-b3ed-940c55935140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:27.133745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=62 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:27.145685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e401a06c-b981-473c-b3ed-940c55935140 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:27.158301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e401a06c-b981-473c-b3ed-940c55935140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:27.158301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:27.427102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:27.428764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:27.486540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166723a1-4205-40e8-a201-c07f53a3034e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:27.490135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:27.490777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:27.491081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:27.491362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:27.501042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:27.502527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db138526-0350-42b1-81fa-3c2666326d60 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:27.511843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 758/1536] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:36:29.730039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:29.730680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:29.730680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:29.732024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 03:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:36:29.737442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabe29-ff65-4d12-87fb-9e4d4ea3b072 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:29.740860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabe29-ff65-4d12-87fb-9e4d4ea3b072 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:29.740860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dabe29-ff65-4d12-87fb-9e4d4ea3b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:29.758228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-66dabe29-ff65-4d12-87fb-9e4d4ea3b072 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:36:29.759509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-66dabe29-ff65-4d12-87fb-9e4d4ea3b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:29.767976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 03:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:36:30.050877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:36:30.052566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:36:30.067162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9debd2a-8e77-4fe1-bd2f-ff20ff7d85df None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:36:30.070744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67147380-de90-4161-bca1-a69658068104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:36:30.071381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67147380-de90-4161-bca1-a69658068104 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:36:30.071666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67147380-de90-4161-bca1-a69658068104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:36:30.071940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67147380-de90-4161-bca1-a69658068104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:36:30.084129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67147380-de90-4161-bca1-a69658068104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:36:30.085603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67147380-de90-4161-bca1-a69658068104 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:36:30.095147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 780/1539] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:36:39.750922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=32 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:36:40.090885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=8 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:04.215476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.216123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.216123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.245167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.247623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.259817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 760/1540] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.272237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427adf-1695-4755-83d9-447da209b620 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.273141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427adf-1695-4755-83d9-447da209b620 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.273141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f427adf-1695-4755-83d9-447da209b620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.303608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9f427adf-1695-4755-83d9-447da209b620 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.305615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9f427adf-1695-4755-83d9-447da209b620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.316826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 781/1541] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.322085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.335007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e15e9-4b9f-4e4a-b6ee-b51351430194 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.343068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.343748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.344039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.344312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.345044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.345405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.347138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1f84dd-141e-43cc-8b6b-50d41b26eae5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.365550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 761/1542] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:04.374110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427adf-1695-4755-83d9-447da209b620 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.384384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f427adf-1695-4755-83d9-447da209b620 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.394368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.399690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.399690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.399690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.399690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.399690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b6d06-d5b1-4371-9505-b8e9a729078b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.404752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f57c-70a6-4a5b-85aa-20095f2e10a6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.405286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f57c-70a6-4a5b-85aa-20095f2e10a6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.405777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980f57c-70a6-4a5b-85aa-20095f2e10a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.442333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8980f57c-70a6-4a5b-85aa-20095f2e10a6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.444449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8980f57c-70a6-4a5b-85aa-20095f2e10a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.455208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 762/1543] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:04.456811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643dd7-7eb6-4418-88d3-7cfaf1997889 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.457319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643dd7-7eb6-4418-88d3-7cfaf1997889 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.457811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643dd7-7eb6-4418-88d3-7cfaf1997889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.490332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b1643dd7-7eb6-4418-88d3-7cfaf1997889 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.490332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b1643dd7-7eb6-4418-88d3-7cfaf1997889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.498895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 763/1544] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.500435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec7f6-670d-4031-a760-6f519c5e0363 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.500753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec7f6-670d-4031-a760-6f519c5e0363 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.501502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ec7f6-670d-4031-a760-6f519c5e0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.523109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 782/1545] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:04.524444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40496bcf-e1fa-4814-affc-3ae1bd162b79 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.524759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40496bcf-e1fa-4814-affc-3ae1bd162b79 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.525025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40496bcf-e1fa-4814-affc-3ae1bd162b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.546448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2b0ec7f6-670d-4031-a760-6f519c5e0363 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.547658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2b0ec7f6-670d-4031-a760-6f519c5e0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.550819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-40496bcf-e1fa-4814-affc-3ae1bd162b79 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.552714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-40496bcf-e1fa-4814-affc-3ae1bd162b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.615923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 764/1546] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.617569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079cfa8-a44f-4b3e-8d39-d343e61fb190 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.617855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079cfa8-a44f-4b3e-8d39-d343e61fb190 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.618132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079cfa8-a44f-4b3e-8d39-d343e61fb190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.631358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 783/1547] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.633154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.633669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.633966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.639202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b079cfa8-a44f-4b3e-8d39-d343e61fb190 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.640401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b079cfa8-a44f-4b3e-8d39-d343e61fb190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.650420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 765/1548] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.651504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea0bc-a3e5-492c-9c51-fe330880058d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.652324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea0bc-a3e5-492c-9c51-fe330880058d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.652660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ea0bc-a3e5-492c-9c51-fe330880058d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.653624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.654808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.665969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 784/1549] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.670959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a97ea0bc-a3e5-492c-9c51-fe330880058d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.672159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a97ea0bc-a3e5-492c-9c51-fe330880058d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.674167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.682704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 766/1550] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.684201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f8d0-3787-4705-9fec-d95f9a645c17 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.684515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f8d0-3787-4705-9fec-d95f9a645c17 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.684846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754f8d0-3787-4705-9fec-d95f9a645c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.688123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ff6e1-254f-47f8-bf32-e2235970b48d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.693140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.694044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.694333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.694613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.695412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.696459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:04.696459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:38:04.696459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:38:04.698052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa19e4f4-c51a-4290-b2eb-9af7fd6b1391 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.703622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e754f8d0-3787-4705-9fec-d95f9a645c17 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.704819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e754f8d0-3787-4705-9fec-d95f9a645c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.714182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 767/1551] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.718814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.724090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.724090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.738585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.739791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.748657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 768/1552] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.749756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.761796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2aee5-7503-4b58-9369-2d66fa46fe4b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.766716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.767359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.767648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.767950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.768793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.769141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.770895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4967131c-e601-4459-ad00-bd65eb678d74 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.789396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 769/1553] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:04.789396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadd577-8401-459f-a678-12094f65ef6e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.789396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadd577-8401-459f-a678-12094f65ef6e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.789396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadd577-8401-459f-a678-12094f65ef6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.804984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8cadd577-8401-459f-a678-12094f65ef6e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.806496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8cadd577-8401-459f-a678-12094f65ef6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.816279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 770/1554] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.817866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.818207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.818521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.836783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.838095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.847846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 771/1555] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.848978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.859870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35361132-b5c8-4965-b2d5-7cb6dcc3353c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.864572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.866751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.866751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.866751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.866751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.867088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.869043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.881621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 772/1556] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:04.882727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.893893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886985ec-2075-4db7-9f0c-a8993919475d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.899267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.900093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.900449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.900744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.901493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.907037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.907158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 785/1557] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:04.907273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef7ecc-2dba-42c8-8de0-ade8fe6f96e8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.907367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.907367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.907367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.917846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 773/1558] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:04.919101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.919393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.920083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.925145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.926495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.934494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 786/1559] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.937637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:04.938093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.938804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:04.951099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 774/1560] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:04.951099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.951356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3b4ca-a9e5-4415-9c76-e4b45a3a41ca None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.954527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.955278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.955612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.955899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.956641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.958440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc36ae-a835-4102-96c7-d89875310783 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.958934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.963513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.965284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.965588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.966407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.966694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.967028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.968644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:04.981012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 775/1561] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:04.981867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:04.991466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3ca34-c851-4ff4-b616-90c3bf5d55ae admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:04.996005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:04.996642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:04.996921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:04.997195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:04.997945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:04.998253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:04.999881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.010978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 776/1562] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:05.015911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.021394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6bdd8-5f08-42e5-9d5d-5201f5f54307 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.025928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.026539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.026939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.027925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.028797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.029822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:05.029822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:38:05.029822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:38:05.030987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda8dda-3641-4127-82b7-69e711959a34 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.044106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:05.081360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 787/1563] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:04 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.082180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.143574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef81bb-55b2-4ee7-b17b-21425b7cdb9d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.148132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.148797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.149082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.149387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.150102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.151684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.162551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 788/1564] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:05.163526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.176714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 777/1565] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/projects => generated 393 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.176934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d45426-b33b-4de6-a30d-52cb1c69cc02 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.177041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.177041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.177041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.189596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:05.194526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:05.195788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:05.236444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.237875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.238022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.238247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.239940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.242798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.263085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 778/1566] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:05.263872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.273634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f2904-6421-4863-8878-5ad9cb082aaf None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.280006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.280677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.280958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.281231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.281983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:05.282288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.283894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.295732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 779/1567] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:05.296507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.305776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8cbc7-1b3c-4eb0-842f-093aaf5854ae admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.310970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.311605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.315875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.315875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.315875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.315875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.378428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 789/1568] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.379341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.440885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 780/1569] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.440885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.446362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e4f3-5d38-48a6-9720-fc76e27dc71e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.506128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.506634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.506924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.507206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.508003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.509840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.512318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe145585-a73f-49e4-a364-e4b735fd815e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.517165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.517875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.518224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.518567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.519329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.523332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.601276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 790/1570] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.602190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.629071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 781/1571] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.629943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.638563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:05.641526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413e9ec-842f-4b66-8798-2ece9f362617 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.668876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4174484-3c7f-46f5-872e-918dc91b327a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.673619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.674286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.674568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.674843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.675562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.677149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.687594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 791/1572] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:05.702042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:05.702186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.702186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a9f192-a4da-480e-a4c8-55d8caf186f1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.702389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.702389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.702389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.702389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.703142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.703504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.704156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.704156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.704438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.705148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:05.705482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.705645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.706553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:05.706553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:38:05.706553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:38:05.707405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.720152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 792/1573] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:05.720928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.731224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec1368c-9285-4886-bdbf-08fb943a6ddc admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.735667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.736296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.736578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.736850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.737554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.739392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.788566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 782/1574] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.789338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.798930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ddf2a-7474-4473-94ee-69a04c26ed85 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.803534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.804175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.804472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.804732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.805434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.807347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.830529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 793/1575] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.833899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.885464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 783/1576] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:05.889947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:05.893231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b959843-f9e2-460b-9c97-069773598bac admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.898374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.899046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.899331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.899551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8df5-511a-43dd-b524-ca5ff7bbf31a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:05.899654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.900280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.902451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:05.904288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:05.904946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:05.905231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:05.905546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:05.906345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:05.908251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.022447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 794/1577] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/users => generated 302 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:06.023449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.033560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609394d8-3f0a-4b18-a559-fbedc89a50ca admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.038108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.039658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.039658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.039882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.040420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.042051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.052207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 784/1578] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:05 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:06.056142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.056302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 795/1579] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.056302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.065837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58cfa2-58ec-49ab-8024-b954f38bee83 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.068930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a923bb-c54c-4db1-bbfd-242d78ae4712 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.070358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.071005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.071288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.071561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.072240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.074229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.076092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.077736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.078270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.078804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] PATH_INFO: `/v3/projects/3268641ef3164a9e934c362142f80fb4/users/2524a1e26aa74ba896771209dca9fbec/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.096225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3268641ef3164a9e934c362142f80fb4, user_id=2524a1e26aa74ba896771209dca9fbec, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.097288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:06.097288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:38:06.097288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:38:06.099232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.302841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 796/1580] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:06 2022] POST /identity/v3/projects => generated 371 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:06.302841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.350591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:06.354357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 785/1581] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:06 2022] PUT /identity/v3/projects/3268641ef3164a9e934c362142f80fb4/users/2524a1e26aa74ba896771209dca9fbec/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:06.356701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.365760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8cd73-a9dc-4697-9210-791eff62aacf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.419651 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d6853-e6d8-4f74-ac12-2e2103306f8a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.424634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.425331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.425533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.426018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.426018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.426206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.426468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.426574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.426743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.427461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.428499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.429022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.442255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 797/1582] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.442255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.450312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2b6b1-0c11-4a63-bee1-b647febb5732 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.454902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.455541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.455822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.456122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.456818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.458464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.469391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 798/1583] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.470066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.479403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb81b66-01e3-4db9-b542-f5276cac87d1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.483896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.484527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.484808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.485081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.485820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.487382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.497864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 799/1584] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.498633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.508194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14677189-1ea9-4779-bb10-9727aec5891b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.513314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.513953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.514269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.514574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.515276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.516855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.526641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 800/1585] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.528146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.538522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad162b-95a7-42a7-9e60-ab824b1a63ae admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.540503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 786/1586] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:06 2022] POST /identity/v3/users => generated 283 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:06.541361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.544206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.544917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.545311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.545736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.546750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.548557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986804-264f-443b-8205-01f3030ad477 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.551675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db10c-d0e0-4ab8-8e1a-ca119ad6c603 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.556913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.557551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.557837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.558219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.559062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.562662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 801/1587] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.562825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.562914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.562914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.562914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.580832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:06.582070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:06.590499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 802/1588] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:06.591248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.600251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11b9a-c3cc-4ebc-ab23-6f340b93d4db None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.604812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.605512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.605793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.606067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.606769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.608341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.618202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 803/1589] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.619018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.628127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a26136-8790-4e6e-8841-ffb58e26d5e0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.632601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.633200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.633511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.633792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.634472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.635981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.646150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 804/1590] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.646895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.656921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11b9a49-94c4-4616-8c4a-eeca7d371852 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.661401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.662025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.662306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.662581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.663275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.664820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.675231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 805/1591] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.676636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.681984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 787/1592] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:06 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:06.683100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.685719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c987c7-59fb-41cc-a647-63b8bebf4609 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.690471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.694500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.694500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.694500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.694500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.694857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbec7e1-95c4-4390-95ae-e40209b36548 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.694967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.698341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.699835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.700276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.700582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.701312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.702907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.708548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 806/1593] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.708548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.716375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee756f-6366-4be6-ad81-f8e6cdd5e565 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.718432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 788/1594] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:06.719254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.722293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.723225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.723513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.723796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] PATH_INFO: `/v3/projects/365d135fec124213aad89af7dcce8347/users/90c10d44a11f410ebf0a15194c9d758b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.739553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=365d135fec124213aad89af7dcce8347, user_id=90c10d44a11f410ebf0a15194c9d758b, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.742293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.761888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=84,keystone:INSERT=16 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:06.773961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499de85c-a1db-4918-82a4-c9ae1519cfa2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.780460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.780460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.780460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.780460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.788576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.790069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.800263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 789/1595] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:06.801037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.811077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aad028-92ee-4e7e-911f-8ce9560b212f service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.815852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.816814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.817114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.817427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] PATH_INFO: `/v3/projects/8c649113d597484d8d1f5f046a8cac59/users/eaf9c9fd3a5d4791907748df8bad800c/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.833848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c649113d597484d8d1f5f046a8cac59, user_id=eaf9c9fd3a5d4791907748df8bad800c, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.836756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.868186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 807/1596] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:06 2022] PUT /identity/v3/projects/365d135fec124213aad89af7dcce8347/users/90c10d44a11f410ebf0a15194c9d758b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:06.868973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:06.907834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:06.929389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95245ed3-cfb0-4512-ae86-1cef0be5cddf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:06.936695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:06.937675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:06.937959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:06.938233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] PATH_INFO: `/v3/projects/6a876142cd9242348aa04e4cc40d08ed/users/9e2388ee001f45638a3d817e4a801c8e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:06.952747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a876142cd9242348aa04e4cc40d08ed, user_id=9e2388ee001f45638a3d817e4a801c8e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:06.955430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:06.988045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 790/1597] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:06 2022] PUT /identity/v3/projects/8c649113d597484d8d1f5f046a8cac59/users/eaf9c9fd3a5d4791907748df8bad800c/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:06.988858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.052888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a93077-1ae0-46ec-a134-05232d14d55c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.057604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.059186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.059558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.059835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] PATH_INFO: `/v3/projects/0101797b84c546ebacacac657d536912/users/902d6d32c08b4eef86107109a1ed85a6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.081444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 808/1598] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:06 2022] PUT /identity/v3/projects/6a876142cd9242348aa04e4cc40d08ed/users/9e2388ee001f45638a3d817e4a801c8e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:07.081444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.081868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0101797b84c546ebacacac657d536912, user_id=902d6d32c08b4eef86107109a1ed85a6, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.083842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.142082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963cce0-ad8f-4d4d-9082-5c4975a92ff3 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.146661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.147319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.147602 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.147879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.148625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.150227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.159864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 809/1599] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:07.160650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.172487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d4523-dbed-4a8e-a3d5-dc6395c40bd6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.177315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.178213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.178477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.178752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] PATH_INFO: `/v3/projects/3ca63dae986749728daf5c42db0d14e3/users/12207cbc940749eab50dc52e3319ec91/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.195435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca63dae986749728daf5c42db0d14e3, user_id=12207cbc940749eab50dc52e3319ec91, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.198138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39018eeb-4f06-47f9-a511-849b3b380dc6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.206725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 791/1600] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:06 2022] PUT /identity/v3/projects/0101797b84c546ebacacac657d536912/users/902d6d32c08b4eef86107109a1ed85a6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:07.206725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.269670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade31433-ec2a-4d6e-bed3-181ff61a4cf7 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.274378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.276870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.276870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.276870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.276870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.278043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f252db-3425-41d2-885e-689f98da6f37 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.288120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 792/1601] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:07.289432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e3040-931d-49da-ad5b-5d68dc57790b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.289718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e3040-931d-49da-ad5b-5d68dc57790b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.289993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e3040-931d-49da-ad5b-5d68dc57790b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.313306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 810/1602] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:07 2022] PUT /identity/v3/projects/3ca63dae986749728daf5c42db0d14e3/users/12207cbc940749eab50dc52e3319ec91/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:07.313306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.313306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.313306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.328948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d84e3040-931d-49da-ad5b-5d68dc57790b None None] MFA Rules not processed for user `90c10d44a11f410ebf0a15194c9d758b`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.330230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d84e3040-931d-49da-ad5b-5d68dc57790b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.330882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.332109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.357217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:07.399591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 793/1604] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:07.399817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 811/1604] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:07.399930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1b7-3918-4cbd-a7de-6c4f8f836865 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.399930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1b7-3918-4cbd-a7de-6c4f8f836865 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.399930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16b1b7-3918-4cbd-a7de-6c4f8f836865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.401744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.412709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc03f2-5173-4001-ad4a-494b939252af None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.419955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.420633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.420972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.421286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.422097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.423879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2683002-7adb-49d4-a3cb-fc54580d50ed admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.428925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1d16b1b7-3918-4cbd-a7de-6c4f8f836865 None None] MFA Rules not processed for user `9e2388ee001f45638a3d817e4a801c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.430195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1d16b1b7-3918-4cbd-a7de-6c4f8f836865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.436208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 812/1605] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:07.437962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.438267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.438648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.459091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.460643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.470353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 813/1606] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:07.471174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.483534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719492b7-03ba-40c1-97cb-2337fab9e151 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.489611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.496490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.496490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.496490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] PATH_INFO: `/v3/projects/b531bdc9089f4e4fa8aaf2ff14908708/users/714201ac30cc4a799ed0ac2c196b41e2/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.513107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:07.517152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 794/1607] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:07.518410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.518801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.519187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.537126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b531bdc9089f4e4fa8aaf2ff14908708, user_id=714201ac30cc4a799ed0ac2c196b41e2, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.541096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.542207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.542616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.554247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 795/1608] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:07.555296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.569882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bb9a5-956c-409b-9f53-b9d0d96b3dcc None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.575688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.576377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.576664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.576940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.577658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.579575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.629516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 814/1609] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:07 2022] PUT /identity/v3/projects/b531bdc9089f4e4fa8aaf2ff14908708/users/714201ac30cc4a799ed0ac2c196b41e2/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:07.635386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.637531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.696441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 796/1610] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:07.697662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.704113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b5da2-dab6-4c40-aa26-13f373e7d8c6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.754614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.755276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.755551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.755849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.768790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad56d-1e55-4e1b-a685-99528edca624 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.773833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.774759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.775038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.775309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] PATH_INFO: `/v3/projects/b38bc680a97f4d44bc0dd62cfce8d20e/users/884cec54a3cd4b78a27bb31ec1f13240/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.790019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b38bc680a97f4d44bc0dd62cfce8d20e, user_id=884cec54a3cd4b78a27bb31ec1f13240, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.793790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.818455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.819915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.829990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 815/1611] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:07.830779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.838453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52ded4-601d-48f7-9e08-e642a4721a0d service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.842611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.843342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.843727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.844017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.853232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.854715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0d5ec-ebbe-4b77-9bc9-a8825ef1cf94 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.864044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 816/1612] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:07.865300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0ea8-e825-42a6-a845-b78507c19895 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.865595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0ea8-e825-42a6-a845-b78507c19895 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.865872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0ea8-e825-42a6-a845-b78507c19895 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.867166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 817/1613] 10.222.0.71 () {54 vars in 961 bytes} [Fri May 27 03:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:07.867854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f0ea8-e825-42a6-a845-b78507c19895 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.879240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f0ea8-e825-42a6-a845-b78507c19895 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:07.882898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:07.883728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.884013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.884291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.894221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:07.895712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03c385-b3ad-4cae-8616-f12f0813af98 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:07.905392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 818/1614] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:07.906690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce365c-4505-486b-8b3f-27e8d22f21af None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:07.906981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce365c-4505-486b-8b3f-27e8d22f21af None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:07.907257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce365c-4505-486b-8b3f-27e8d22f21af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:07.936510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-98ce365c-4505-486b-8b3f-27e8d22f21af None None] MFA Rules not processed for user `714201ac30cc4a799ed0ac2c196b41e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:07.938437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-98ce365c-4505-486b-8b3f-27e8d22f21af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:07.950074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 797/1615] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:07 2022] PUT /identity/v3/projects/b38bc680a97f4d44bc0dd62cfce8d20e/users/884cec54a3cd4b78a27bb31ec1f13240/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:07.951356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:07.976252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:08.029005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 819/1616] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:08.030740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015953b-43e1-4d14-b731-581c84227c3a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.031135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015953b-43e1-4d14-b731-581c84227c3a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.031646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015953b-43e1-4d14-b731-581c84227c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.044668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb006f0-a2e9-43b4-97da-55cd779bd155 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.049695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.050544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.050837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.051115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.051804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.053788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.059770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9015953b-43e1-4d14-b731-581c84227c3a None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:08.062203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9015953b-43e1-4d14-b731-581c84227c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:08.135834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 820/1617] 10.222.0.71 () {58 vars in 1058 bytes} [Fri May 27 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:08.143552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.143851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.144179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.173780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] MFA Rules not processed for user `884cec54a3cd4b78a27bb31ec1f13240`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:08.197933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:08.237580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 821/1618] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:08.238428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.294424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee2d34-8ac0-4c8d-a1d1-ae1f01d0bde1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.298253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.298916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.299201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.299476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.309237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.312767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.318682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:08.319006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 798/1619] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:07 2022] POST /identity/v3/users => generated 289 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:08.320451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.325833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 822/1620] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:08.326573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.337100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91986411-7cf6-4652-84ce-e0fdcbadf259 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.337892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59d0e-6fcf-4c90-b1f7-4cc4e1d5a4e6 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.343845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.344581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.344715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.345134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.361514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.361811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.362253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.362364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.362364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.362538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.503979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 823/1621] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:08 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:08.505703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.538517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.540381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.568231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 799/1622] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:08.573151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.600480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62df32-12d6-48ec-b302-010e7da5eb2b service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.659506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a59502-a6f9-48a7-8dd6-56c06a081d2b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.670696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.673135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.674228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.675674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.676572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.681242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c57e23-4cb8-4232-b497-6e2643c393f7 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.712771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 824/1623] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:08.714991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782927-36a6-4efd-91db-eba07d052551 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.716209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782927-36a6-4efd-91db-eba07d052551 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.716618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53782927-36a6-4efd-91db-eba07d052551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.780838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-53782927-36a6-4efd-91db-eba07d052551 None None] MFA Rules not processed for user `2524a1e26aa74ba896771209dca9fbec`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:08.786050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-53782927-36a6-4efd-91db-eba07d052551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:08.927545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.928226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.928513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.930217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.930938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.932887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a53943-6a03-4eba-9779-1f5f8b2d4d20 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:08.936782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 825/1624] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:08.941000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53782927-36a6-4efd-91db-eba07d052551 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:08.956741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53782927-36a6-4efd-91db-eba07d052551 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:08.966880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:08.969729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:08.969729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:08.969729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] PATH_INFO: `/v3/projects/f778ec32c0c54a4f8cec642603154406/users/7fc55e9f9e85460f9672055f7728d127/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:08.987976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f778ec32c0c54a4f8cec642603154406, user_id=7fc55e9f9e85460f9672055f7728d127, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:08.991246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.057830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:09.061526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 800/1625] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:08 2022] POST /identity/v3/users => generated 292 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:09.063096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.064179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.064717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.094727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] MFA Rules not processed for user `2524a1e26aa74ba896771209dca9fbec`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:09.096965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:09.115857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 801/1626] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:09.115857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.157752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 826/1627] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:08 2022] PUT /identity/v3/projects/f778ec32c0c54a4f8cec642603154406/users/7fc55e9f9e85460f9672055f7728d127/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:09.157752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.158497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a45e43-d6f6-44cd-a427-4d70bb2d8f33 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.223102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:09.359136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.361833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.363594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.364060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.365875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591eadd-3925-4c6a-8e18-91c44ab58638 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.366704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.374814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.388149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.390693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.391813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.392290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.415122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:09.431902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 802/1628] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:09.431902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.460165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d623ded-22eb-4039-ac2c-9ab2b1db6b86 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.469209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.470248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.470721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.471217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.472670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.475536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.500784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 803/1629] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:09.500784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.518411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d266e-2c86-4200-aa57-5715d3b932c8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.527041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.529233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.530889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.531198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.531676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.532925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] PATH_INFO: `/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d/users/cf459108639c44149bad7125fd940632/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.555359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 827/1630] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:09.556709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.581824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299cf65-9f37-4beb-91ee-12e7a884745c service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.584910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a19ae34796a4ed1b0e67b8d087d427d, user_id=cf459108639c44149bad7125fd940632, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.587644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.588768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.593391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413c87e-77e0-4d4a-9b4e-265da162a276 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.593805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.594811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] PATH_INFO: `/v3/projects/f778ec32c0c54a4f8cec642603154406/users/7fc55e9f9e85460f9672055f7728d127/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.597425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f778ec32c0c54a4f8cec642603154406, user_id=7fc55e9f9e85460f9672055f7728d127, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.601295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff798de5-816a-4689-9eea-4dcb67d24e8a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.648248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 828/1631] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:09 2022] PUT /identity/v3/projects/f778ec32c0c54a4f8cec642603154406/users/7fc55e9f9e85460f9672055f7728d127/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecede9a-0424-4055-a4be-46e756254750 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecede9a-0424-4055-a4be-46e756254750 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecede9a-0424-4055-a4be-46e756254750 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 829/1632] 10.222.0.71 () {54 vars in 912 bytes} [Fri May 27 03:38:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851015ab-3e41-442e-828d-9c969241f07c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.682543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851015ab-3e41-442e-828d-9c969241f07c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.684332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851015ab-3e41-442e-828d-9c969241f07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.702441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-851015ab-3e41-442e-828d-9c969241f07c None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:09.703739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-851015ab-3e41-442e-828d-9c969241f07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:09.770672 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 804/1633] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:09 2022] PUT /identity/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d/users/cf459108639c44149bad7125fd940632/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:09.772254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75ad5-4b5a-4eb8-a5c5-0651028ee065 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.772764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75ad5-4b5a-4eb8-a5c5-0651028ee065 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.773221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd75ad5-4b5a-4eb8-a5c5-0651028ee065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.799594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9cd75ad5-4b5a-4eb8-a5c5-0651028ee065 None None] MFA Rules not processed for user `7fc55e9f9e85460f9672055f7728d127`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:09.800785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9cd75ad5-4b5a-4eb8-a5c5-0651028ee065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:09.802926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 830/1634] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:09.804375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1456-5a95-4b25-bbcd-f06ebbdda71c None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.804702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1456-5a95-4b25-bbcd-f06ebbdda71c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.805054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a1456-5a95-4b25-bbcd-f06ebbdda71c None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.806530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 831/1635] 10.222.0.71 () {54 vars in 961 bytes} [Fri May 27 03:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:09.807079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1456-5a95-4b25-bbcd-f06ebbdda71c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.876615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 805/1636] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:09.877454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a1456-5a95-4b25-bbcd-f06ebbdda71c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.878049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.878343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.878625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.892931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.893689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.893929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.894203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:09.894928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:09.896524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:09.906781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 832/1637] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:09.907660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:09.909351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:09.918465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:09.919657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:09.991621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1593f2-eb26-46f9-9a0f-1889a64882c0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:09.996409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:09.997245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:09.997683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:09.997970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.005813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 806/1638] 10.222.0.71 () {58 vars in 1058 bytes} [Fri May 27 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:10.007721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.031309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.031309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.038213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 833/1639] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:10.038953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.050399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87591649-960f-4726-95f8-b7ce4c6c006a service glance] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:10.055818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:10.057113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.057680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.058253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] PATH_INFO: `/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d/users/cf459108639c44149bad7125fd940632/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.061158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a19ae34796a4ed1b0e67b8d087d427d, user_id=cf459108639c44149bad7125fd940632, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.067129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6deade1-1217-49b0-a3f1-33dd4f4c345e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 834/1640] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:10 2022] PUT /identity/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d/users/cf459108639c44149bad7125fd940632/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ceb50-a19c-48b4-b19e-d146c53ed4d5 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ceb50-a19c-48b4-b19e-d146c53ed4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ceb50-a19c-48b4-b19e-d146c53ed4d5 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 835/1641] 10.222.0.71 () {54 vars in 912 bytes} [Fri May 27 03:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:10.091271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67e1b4-b7de-4a95-bdb7-86f5f4e542fc None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.092417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67e1b4-b7de-4a95-bdb7-86f5f4e542fc None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.092417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b67e1b4-b7de-4a95-bdb7-86f5f4e542fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.113662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0b67e1b4-b7de-4a95-bdb7-86f5f4e542fc None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:10.122960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10be50-cc02-4cbe-b3eb-8475ca80ff2a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:10.123092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0b67e1b4-b7de-4a95-bdb7-86f5f4e542fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:10.172260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:10.173056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.173474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.173826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.190214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 836/1642] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:10.191786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.192178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.192823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.223530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] MFA Rules not processed for user `cf459108639c44149bad7125fd940632`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:10.225129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:10.282437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.285427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.292973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:10.318678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 807/1643] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:10.320038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.340970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e687d30-00df-49c6-93dc-5442132460ad service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:10.349976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:10.350647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.350929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.351708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.641330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 837/1644] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:10.675131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.675131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35ea2-c14a-471b-b031-987901225227 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.675131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 808/1645] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:10.676533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.676533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f94bb-c580-4a8b-854e-27ad16b021fa None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:10.676533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:10.676533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.681173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.681173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.681173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.681173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05783f60-3f52-4ad4-87a9-475dfe49b5eb service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.681173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 838/1646] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:10.682662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2748-47f6-4514-ab1e-b50c6f84b222 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.682662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2748-47f6-4514-ab1e-b50c6f84b222 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.682662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de2748-47f6-4514-ab1e-b50c6f84b222 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.682662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 809/1647] 10.222.0.71 () {54 vars in 912 bytes} [Fri May 27 03:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:10.686054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.686054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.686054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.705435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:10.706779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:10.774733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 839/1648] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:10.794316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2748-47f6-4514-ab1e-b50c6f84b222 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.804061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:10.816888 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892dcea-261c-4f1d-9070-b0cf6a72f228 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:10.832681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:10.833411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.833727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.833958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.844496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:10.846356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26df625-736b-40ca-b77b-5c0f7a35070d service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:10.875193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 840/1649] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:10.878410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:10.878726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:10.879008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:10.915645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] MFA Rules not processed for user `902d6d32c08b4eef86107109a1ed85a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:10.918569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:11.004998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de2748-47f6-4514-ab1e-b50c6f84b222 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:11.017666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 841/1650] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:11.019953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:11.023243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:11.024156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.024412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.024682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] PATH_INFO: `/v3/users/9e2388ee001f45638a3d817e4a801c8e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.030242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2388ee001f45638a3d817e4a801c8e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:11.031378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: WARNING py.warnings [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:11.031378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: warnings.warn(msg) May 27 03:38:11.031378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: May 27 03:38:11.032661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:11.033914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5536aa9a-d13c-4450-ae5b-386f7477ae98 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:11.038259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:11.039819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.040320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.040919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.164240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:11.168037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:11.194541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 842/1651] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:11.196061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:11.211131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:11.246531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc6e6d3-9b11-45a6-8546-ea5abcde314f service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:11.263094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:11.264852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.266667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.267807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.269466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:11.277488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:11.371534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2388ee001f45638a3d817e4a801c8e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:11.405364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2388ee001f45638a3d817e4a801c8e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:11.485099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 843/1652] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:11 2022] POST /identity/v3/projects => generated 405 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:11.489608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:11.500935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2388ee001f45638a3d817e4a801c8e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:11.501773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2388ee001f45638a3d817e4a801c8e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:11.502401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-08400121-ef03-429a-b200-da593a45a05b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2388ee001f45638a3d817e4a801c8e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:11.541725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 810/1653] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:10 2022] DELETE /identity/v3/users/9e2388ee001f45638a3d817e4a801c8e => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:11.553603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.553901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.554186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.580107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:11.581830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:11.630377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930e53c-01cc-45ac-b907-c8407ac73911 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:11.716251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 811/1654] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:11.723185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:11.723185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.723185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.723185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.724491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:11.724981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d629370-7956-4021-90f7-9b02188273c7 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:11.802736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:11.806520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:11.905050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 844/1655] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:11 2022] POST /identity/v3/users => generated 309 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:11.906948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.907434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.907971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.913901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 845/1656] 10.222.0.71 () {54 vars in 960 bytes} [Fri May 27 03:38:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:11.915038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:11.917176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:11.941667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55202206-b540-4dee-9ff4-6b88b3172a47 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:11.946968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:11.948129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.948514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.948514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.949840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:11.951544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51176c54-c1e7-48c6-bb48-bbeccb5e903e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:11.964556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 846/1657] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:11.966612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:11.967128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:11.967543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:11.989375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:11.990943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:11.994921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247607dd-8b35-4fbf-b318-89f2cb14f0af None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.002775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.003456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.003790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.016694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.072493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.079395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.111472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 812/1658] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:12.121144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:12.126916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03885-01be-4df1-9e2e-4587e4608ca3 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.140937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.144411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.146241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.147417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] PATH_INFO: `/v3/projects/fdb8d5aa1d2447aab523d3df511f005d/users/3aa03151bd5e4b1abfc12cf0e62f7b7c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.173861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 847/1659] 10.222.0.71 () {58 vars in 1057 bytes} [Fri May 27 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:12.182875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:12.190860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8d5aa1d2447aab523d3df511f005d, user_id=3aa03151bd5e4b1abfc12cf0e62f7b7c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.200886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.210182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087059f4-53e5-4b7f-b461-9e4d463056ec None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.221446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.222470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.222766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.223224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.225191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:12.239436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.242025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.255507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 848/1660] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:12.327208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 813/1661] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:12 2022] PUT /identity/v3/projects/fdb8d5aa1d2447aab523d3df511f005d/users/3aa03151bd5e4b1abfc12cf0e62f7b7c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:12.331142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:12.358903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d171f9-f42b-461a-ac2f-d7352863a769 service placement] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.381927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:12.411973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:12.413979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:12.512206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.512996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.513425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.513801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.514627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.518568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.530467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 849/1662] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:12.546298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:12.555462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6f551-b33b-45ea-bf8e-62b29e192732 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.561697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.562724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.563103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.563449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] PATH_INFO: `/v3/users/884cec54a3cd4b78a27bb31ec1f13240` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.564921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856726a8-e1d7-4392-a988-0f2d4de3a72d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:12.565458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=884cec54a3cd4b78a27bb31ec1f13240)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.568219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.574925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:12.576259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:12.577248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:12.579161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] PATH_INFO: `/v3/projects/fdb8d5aa1d2447aab523d3df511f005d/users/3aa03151bd5e4b1abfc12cf0e62f7b7c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:12.586469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb8d5aa1d2447aab523d3df511f005d, user_id=3aa03151bd5e4b1abfc12cf0e62f7b7c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:12.599415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c852a8-9d58-45e3-91b3-7a5e0ccabc6d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:12.650997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 850/1663] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:12 2022] PUT /identity/v3/projects/fdb8d5aa1d2447aab523d3df511f005d/users/3aa03151bd5e4b1abfc12cf0e62f7b7c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:12.790615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884cec54a3cd4b78a27bb31ec1f13240'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:12.825911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884cec54a3cd4b78a27bb31ec1f13240'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:12.959257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884cec54a3cd4b78a27bb31ec1f13240'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:12.960196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884cec54a3cd4b78a27bb31ec1f13240'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:12.961429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884cec54a3cd4b78a27bb31ec1f13240'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.000181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:13.001696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 814/1664] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:12 2022] DELETE /identity/v3/users/884cec54a3cd4b78a27bb31ec1f13240 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:13.006448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:13.006733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:13.007009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:13.044034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:13.045251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:13.223763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:13.293341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 851/1665] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:13.395767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:13.400237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:13.400860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:13.404198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:13.425498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf910ca9-fde4-4d3c-9cf0-0d0550e98e62 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:13.436098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:13.437286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:13.437716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:13.437997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] PATH_INFO: `/v3/projects/6a876142cd9242348aa04e4cc40d08ed` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:13.439616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a876142cd9242348aa04e4cc40d08ed)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:13.440822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: WARNING py.warnings [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 03:38:13.440822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: warnings.warn(msg) May 27 03:38:13.440822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: May 27 03:38:13.443109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:13.559655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3045167-a93d-4e2d-b8ef-6e9f94036b74 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:13.563920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:13.564585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:13.564872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:13.565385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:13.581845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:13.584312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e60ecba-28cc-48dc-a5d6-48232ca3a4f9 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:13.600075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 815/1666] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:13.646970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a876142cd9242348aa04e4cc40d08ed', 'request_id': 'req-e6b4d920-db18-4d33-bfa2-82b6b606eb90'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.679536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a876142cd9242348aa04e4cc40d08ed', 'request_id': 'req-e6b4d920-db18-4d33-bfa2-82b6b606eb90'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.697360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a876142cd9242348aa04e4cc40d08ed', 'request_id': 'req-e6b4d920-db18-4d33-bfa2-82b6b606eb90'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.868057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] The token cache is being invalidate because project 6a876142cd9242348aa04e4cc40d08ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:13.868356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.870932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e6b4d920-db18-4d33-bfa2-82b6b606eb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:13.873424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 852/1667] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:13 2022] DELETE /identity/v3/projects/6a876142cd9242348aa04e4cc40d08ed => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:13.879591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:13.880050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:13.880338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:13.913814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:13.917886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:14.163045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 816/1668] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:14.170886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:14.171334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:14.178387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:14.241566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:14.248366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:14.272046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 853/1669] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:14.276424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:14.299866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb67721-e261-4a91-9a69-855c2e64dd90 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:14.301336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:14.302039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:14.302387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:14.302669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:14.303403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:14.303876 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:14.306769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:14.354025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:14.355854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 817/1670] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:14.365782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a6628-22dd-4e2a-8622-b3578018ebfa None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:14.388878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:14.389709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:14.390044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:14.390334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:14.391036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:14.392985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:14.549518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 854/1671] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:14 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:14.553449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:14.574036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815fe11-b755-40b3-97fe-4a83480b1a28 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:14.690257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:14.691112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:14.691534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:14.691947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:14.692877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:14.696364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:14.759495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:14.832743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 818/1672] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:14 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:14.836913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:14.877664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac8d92-5fe8-4eb9-ac97-4bfd26acec88 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:14.908612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:14.913081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:14.913715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:14.915278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:14.916942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:14.925448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:14.956140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 855/1673] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:14.959410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:14.979548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec7b-7f32-4b84-a185-659599644437 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:15.000521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:15.004582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.004582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:15.004582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:15.004582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:15.004582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce194aa4-58fa-4921-adb5-347014ce36e5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:15.023311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 819/1674] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:15.029404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:15.050362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc249be-a095-4000-8321-7f7116d59733 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:15.069428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:15.073214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.073771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:15.075376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] PATH_INFO: `/v3/projects/865e3525754b4fc18f6e26c011be7f43/users/a6fbefed05014e6b915a6630b5b38eed/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:15.125588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865e3525754b4fc18f6e26c011be7f43, user_id=a6fbefed05014e6b915a6630b5b38eed, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:15.130179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:15.265211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 856/1675] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:15 2022] PUT /identity/v3/projects/865e3525754b4fc18f6e26c011be7f43/users/a6fbefed05014e6b915a6630b5b38eed/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:15.266304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.266670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:15.267018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:15.337997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:15.341170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:15.354474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] MFA Rules not processed for user `a6fbefed05014e6b915a6630b5b38eed`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:15.356407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:15.533403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a91c3d-c4f3-4bf6-a318-a69a573f91a8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:15.546854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 820/1676] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:15.552028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:15.554260 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:15.556516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.560561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:15.561001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] PATH_INFO: `/v3/projects/b38bc680a97f4d44bc0dd62cfce8d20e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:15.574111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b38bc680a97f4d44bc0dd62cfce8d20e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:15.576687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:15.587231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81835f1-05f0-425a-801f-4c0feeaa4a76 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:15.609380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:15.610285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.612946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:15.615350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:15.616410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:15.619713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:15.639731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:15.810776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 821/1677] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:15 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:15.815775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:15.822848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:15.845872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b38bc680a97f4d44bc0dd62cfce8d20e', 'request_id': 'req-c3a8e822-de00-466f-884b-ba3ef24911a9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:15.859039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b38bc680a97f4d44bc0dd62cfce8d20e', 'request_id': 'req-c3a8e822-de00-466f-884b-ba3ef24911a9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:15.873870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b38bc680a97f4d44bc0dd62cfce8d20e', 'request_id': 'req-c3a8e822-de00-466f-884b-ba3ef24911a9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:15.971205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1dc74-d638-4062-9457-06dddb2b5b3f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:15.993557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:15.994145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:15.995522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] The token cache is being invalidate because project b38bc680a97f4d44bc0dd62cfce8d20e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:15.995822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:15.997109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:15.999753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.002740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.002903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 857/1678] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:15 2022] DELETE /identity/v3/projects/b38bc680a97f4d44bc0dd62cfce8d20e => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:16.005689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:16.008022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:16.008396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:16.012454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:16.130893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8e822-de00-466f-884b-ba3ef24911a9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:16.141163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:16.145640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:16.145640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.145640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] PATH_INFO: `/v3/users/cf459108639c44149bad7125fd940632` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.145640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf459108639c44149bad7125fd940632)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:16.148261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:16.155981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 822/1679] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:15 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:16.156959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:16.164899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:16.234864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af684a64-241c-4438-9f86-2030f8f79dee admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:16.262785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:16.263889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:16.264369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.264842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.266119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:16.280784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ca675-737e-4e69-98e8-e3168f0470b8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:16.349635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 823/1680] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:16.352030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:16.352527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.353026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.404032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf459108639c44149bad7125fd940632'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.405531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf459108639c44149bad7125fd940632'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.436112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf459108639c44149bad7125fd940632'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.446700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] MFA Rules not processed for user `3aa03151bd5e4b1abfc12cf0e62f7b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:16.469098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:16.537504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf459108639c44149bad7125fd940632'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.538434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf459108639c44149bad7125fd940632'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.560948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 858/1681] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:16 2022] DELETE /identity/v3/users/cf459108639c44149bad7125fd940632 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:16.562208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:16.564839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:16.651012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83245c2-f56a-4a29-bfcd-6da15ede0f60 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:16.657677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:16.665364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:16.665364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.665364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] PATH_INFO: `/v3/projects/bea6c99e126749c09530e19e99f02a1a/users/95d6185f85b34c2f997d4cbb528f8acc/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.682186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea6c99e126749c09530e19e99f02a1a, user_id=95d6185f85b34c2f997d4cbb528f8acc, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:16.687065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:16.693508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 824/1682] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:16.695015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:16.696812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:16.714826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa87fc6-fc6d-4212-a8fa-c07f0b2f8704 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:16.722858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:16.724127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:16.724579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:16.725038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] PATH_INFO: `/v3/users/90c10d44a11f410ebf0a15194c9d758b` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:16.726890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c10d44a11f410ebf0a15194c9d758b)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:16.729445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:16.787454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 859/1683] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:16 2022] PUT /identity/v3/projects/bea6c99e126749c09530e19e99f02a1a/users/95d6185f85b34c2f997d4cbb528f8acc/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:16.793874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:16.941735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c10d44a11f410ebf0a15194c9d758b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:16.982973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c10d44a11f410ebf0a15194c9d758b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:17.003077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140da8f-8759-44b4-b38f-2064a4dad080 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:17.018027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:17.019123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.019123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.019388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.020267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:17.022921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:17.049304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 860/1684] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:17.053230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:17.068300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c10d44a11f410ebf0a15194c9d758b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:17.068961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c10d44a11f410ebf0a15194c9d758b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:17.069760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c5e34b52-4a86-403b-8517-a68ea33b8856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c10d44a11f410ebf0a15194c9d758b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:17.102317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 825/1685] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:16 2022] DELETE /identity/v3/users/90c10d44a11f410ebf0a15194c9d758b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:17.104651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:17.107067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595882a-5298-4434-ae96-90a3257132f6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:17.107385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.107685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.107966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.185045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:17.189501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:17.216221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:17.217641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.218275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.218788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] PATH_INFO: `/v3/projects/bea6c99e126749c09530e19e99f02a1a/users/95d6185f85b34c2f997d4cbb528f8acc/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.222619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea6c99e126749c09530e19e99f02a1a, user_id=95d6185f85b34c2f997d4cbb528f8acc, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:17.226112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c92338-771a-496a-beec-143f4c1e56c1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:17.242149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 861/1686] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:17 2022] PUT /identity/v3/projects/bea6c99e126749c09530e19e99f02a1a/users/95d6185f85b34c2f997d4cbb528f8acc/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:17.258236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.258964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.260099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.354900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 826/1687] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:17.368613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] MFA Rules not processed for user `95d6185f85b34c2f997d4cbb528f8acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:17.369887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:17.379508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:17.381007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:17.534518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cac67-3cce-41c1-a98d-abf9ca4b8eac None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:17.579983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 862/1688] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:17.593294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:17.606198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:17.617660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:17.618482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.618771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.619094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.757828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa019db9-54f2-4cc8-9ce0-6ea1281da94d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:17.768525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:17.769815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:17.770104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:17.770424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:17.774124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:17.775743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:17.793318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:17.795198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929218a2-8816-4ec9-9d7a-2a4dd54375c6 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:17.802171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 827/1689] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:17.822465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 863/1690] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:17.924829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:18.100733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:18.102408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.147298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0205d3e5-63ff-4b4a-a1a3-b790d5a180fc service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:18.179314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:18.184060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:18.193499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:18.193778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:18.200655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.201061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:18.201390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:18.201676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:18.225886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:18.227481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:18.366856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 864/1691] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:18.377035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:18.378914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:18.397725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 828/1692] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:18.911492 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:18.912990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:19.085395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c79234-109b-40ae-8e2b-43d1c8fb3023 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:19.094781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:19.095745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:19.096176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:19.096672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:19.108083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:19.110901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7256047-3629-4222-aa72-f7b735b88ba0 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:19.127547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 865/1693] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:38:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:38:19.599227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:19.752390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:19.755175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:19.776420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:19.793606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997972a-f917-4156-9249-e6e3c9711469 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:19.857624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:19.859125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:19.859477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:19.859769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] PATH_INFO: `/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:19.863816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a19ae34796a4ed1b0e67b8d087d427d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:19.867220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:19.982333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3934-eeab-4761-b39e-736396f66ef3 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:19.982827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3934-eeab-4761-b39e-736396f66ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:19.983105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3934-eeab-4761-b39e-736396f66ef3 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:19.986747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 866/1694] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:38:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:20.008528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.008814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.009349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.062791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:20.064112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:20.080222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a19ae34796a4ed1b0e67b8d087d427d', 'request_id': 'req-9b10129a-e6d6-42c1-9322-5094d68a048e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:20.099024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a19ae34796a4ed1b0e67b8d087d427d', 'request_id': 'req-9b10129a-e6d6-42c1-9322-5094d68a048e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:20.127342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a19ae34796a4ed1b0e67b8d087d427d', 'request_id': 'req-9b10129a-e6d6-42c1-9322-5094d68a048e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:20.231609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] The token cache is being invalidate because project 1a19ae34796a4ed1b0e67b8d087d427d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:20.231902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:20.237876 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b10129a-e6d6-42c1-9322-5094d68a048e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:20.242383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 829/1695] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:19 2022] DELETE /identity/v3/projects/1a19ae34796a4ed1b0e67b8d087d427d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:20.249159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.249668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.250180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.502443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 867/1696] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:20.502443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:20.502443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:20.503702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:20.503702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:20.504122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba216d54-9f86-40d1-b68c-6c4888e58855 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:20.504122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:20.504122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.504122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.504426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.504426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:20.504426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969a577-34f0-402f-88d2-4af4d8509708 service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:20.526215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 868/1697] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:20.757865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 830/1698] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:20.759718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.760108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.760453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.802327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:20.810076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:20.849456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 869/1699] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:20.851120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:20.899350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233ff59-76c6-41cd-88e4-50ccd4c89fe8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:20.935113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:20.936263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:20.936931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:20.937053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.937324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.952078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.952078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:20.952078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:20.952078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:20.965978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a71a68-91b3-41d5-bb3c-5a3122832aed None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:20.986120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:20.987104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:20.987730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:20.988282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 831/1700] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:20.988555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] PATH_INFO: `/v3/projects/365d135fec124213aad89af7dcce8347` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:20.993002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:21.003758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] RBAC: Authorizing `identity:delete_project(project_id=365d135fec124213aad89af7dcce8347)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:21.004503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:21.014718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f21089-348c-4a7c-986f-8b8e110a4804 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:21.027260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:21.027976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:21.028260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:21.028539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:21.029235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:21.032203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:21.246220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 832/1701] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:20 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:21.251210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:21.324593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '365d135fec124213aad89af7dcce8347', 'request_id': 'req-16c2b000-64c4-43a9-aa4b-7d9798e2427f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.342067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '365d135fec124213aad89af7dcce8347', 'request_id': 'req-16c2b000-64c4-43a9-aa4b-7d9798e2427f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.362286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '365d135fec124213aad89af7dcce8347', 'request_id': 'req-16c2b000-64c4-43a9-aa4b-7d9798e2427f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.455501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714744e4-66ff-47e9-805d-66367936c75c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:21.472646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] The token cache is being invalidate because project 365d135fec124213aad89af7dcce8347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:21.474158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.474595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.477024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 870/1702] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:20 2022] DELETE /identity/v3/projects/365d135fec124213aad89af7dcce8347 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:21.485856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:21.490161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:21.597069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:21.597916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:21.598275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:21.598554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:21.599281 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:21.602514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297c02a-b8ad-482b-97f5-588b2b373ab1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:21.634352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b000-64c4-43a9-aa4b-7d9798e2427f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:21.640712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:21.641744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:21.642099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:21.643098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] PATH_INFO: `/v3/users/7fc55e9f9e85460f9672055f7728d127` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:21.645090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fc55e9f9e85460f9672055f7728d127)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:21.647468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:21.760112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 833/1703] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:21 2022] POST /identity/v3/users => generated 284 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:21.764933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6c8a3-5f9f-46bf-a92e-2c3baa58fe2e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:21.766626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6c8a3-5f9f-46bf-a92e-2c3baa58fe2e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:21.767839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6c8a3-5f9f-46bf-a92e-2c3baa58fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:21.803938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-bbd6c8a3-5f9f-46bf-a92e-2c3baa58fe2e None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:21.821755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bbd6c8a3-5f9f-46bf-a92e-2c3baa58fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:21.868296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fc55e9f9e85460f9672055f7728d127'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.871904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fc55e9f9e85460f9672055f7728d127'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.907485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fc55e9f9e85460f9672055f7728d127'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.986019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 834/1704] 10.222.0.72 () {58 vars in 1015 bytes} [Fri May 27 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:21.988795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fc55e9f9e85460f9672055f7728d127'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:21.989447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fc55e9f9e85460f9672055f7728d127'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:22.015726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.017431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.017781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.028472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 871/1705] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:21 2022] DELETE /identity/v3/users/7fc55e9f9e85460f9672055f7728d127 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:22.029596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:22.043811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.163066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] MFA Rules not processed for user `eaf9c9fd3a5d4791907748df8bad800c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:22.180389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.347845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcf4de-4283-43d6-828c-df6516f48e90 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:22.364754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:22.369804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.375582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.376038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.383844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:22.413627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:22.455469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:22.474686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 872/1706] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:22.480934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:22.490728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.515996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 835/1707] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 529 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:22.521251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:22.555531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67975a71-70f0-4cb0-bf05-c647cd93284b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:22.555531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:22.556469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.556873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.569511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.574468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:22.590157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb861dab-8cef-431a-9d88-4142f32965b4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:22.630993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 836/1708] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:22.630993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.630993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.630993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.680365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:22.687598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] MFA Rules not processed for user `eaf9c9fd3a5d4791907748df8bad800c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:22.690255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.719556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 837/1709] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:22.721196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:22.740150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70059e2c-93e6-43d7-ac8d-4257242c4c18 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:22.756040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:22.756887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.757233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.757570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.761796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.763964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910fec-4a55-4e29-9b3c-3841fb2fb695 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:22.773577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:22.774497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.775029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.775315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] PATH_INFO: `/v3/projects/2b7705badd234d2fadcc2690a4d01078/users/8411fed2541f46ffaf162d4d826db33f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:22.810469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7705badd234d2fadcc2690a4d01078, user_id=8411fed2541f46ffaf162d4d826db33f, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:22.814882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7045c1-a6e5-4df7-9479-a53ef4f26ee5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:22.815765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:22.820310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:22.853365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 873/1710] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:22.855623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:22.867168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:22.977176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 838/1711] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:22 2022] PUT /identity/v3/projects/2b7705badd234d2fadcc2690a4d01078/users/8411fed2541f46ffaf162d4d826db33f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:22.993185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:22.993778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:22.996650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:23.077681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] MFA Rules not processed for user `8411fed2541f46ffaf162d4d826db33f`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:23.094277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:23.102581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d250f8-9103-4511-9db6-c552fd0d1aa3 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:23.255130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 839/1712] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:23.260755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:23.336903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:23.338789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:23.339185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:23.341482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:23.482079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462c89c-2ff0-4eb8-a633-c0ad830c6657 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:23.503783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:23.505566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:23.518565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:23.521604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:23.522353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:23.522853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:23.538658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:23.547681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:23.555971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 874/1713] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:23.759838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 840/1714] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:23 2022] POST /identity/v3/projects => generated 365 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:23.762083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:23.790125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a6d42-3a88-49ac-ae84-6026ef3a3d63 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:23.806667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:23.808680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:23.916153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:23.916669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:23.917915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:23.917915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:23.918757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:23.921118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee1276-1fd9-44f4-8b79-f049ef6b5e79 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:23.966847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71de13f-1705-454e-b59d-2f9f7ef5e72d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:23.973835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:23.975357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:23.982290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:23.982290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] PATH_INFO: `/v3/users/714201ac30cc4a799ed0ac2c196b41e2` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:23.982290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714201ac30cc4a799ed0ac2c196b41e2)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:23.982290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:24.094887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 875/1715] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:23 2022] POST /identity/v3/users => generated 289 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:24.099381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:24.099752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:24.099970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:24.199616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] MFA Rules not processed for user `12207cbc940749eab50dc52e3319ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:24.200980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:24.415285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714201ac30cc4a799ed0ac2c196b41e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.416817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 876/1716] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:24.438360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:24.456285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6d316-d946-46cc-a004-9268de4705a4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:24.463570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714201ac30cc4a799ed0ac2c196b41e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.479274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:24.481567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:24.481567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:24.481567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:24.481918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:24.483856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:24.518541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 877/1717] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:24.520816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:24.527731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:24.548349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714201ac30cc4a799ed0ac2c196b41e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.549083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714201ac30cc4a799ed0ac2c196b41e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.549797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714201ac30cc4a799ed0ac2c196b41e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.578114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6adb00-2993-4db0-8f37-13153e83aa54 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:24.595847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:24.599883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 841/1718] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:23 2022] DELETE /identity/v3/users/714201ac30cc4a799ed0ac2c196b41e2 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:24.604300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:24.608400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:24.609066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:24.610423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:24.611278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] PATH_INFO: `/v3/users/902d6d32c08b4eef86107109a1ed85a6` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:24.616433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902d6d32c08b4eef86107109a1ed85a6)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:24.617204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:24.619715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:24.820448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac0fcd-9555-41e8-a648-037ec964dbd0 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:24.852745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:24.854243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:24.855576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:24.856006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:24.860431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:24.939177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902d6d32c08b4eef86107109a1ed85a6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:24.941435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902d6d32c08b4eef86107109a1ed85a6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.007374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:25.018116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902d6d32c08b4eef86107109a1ed85a6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.099047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:25.101169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:25.118539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 842/1719] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:25.119863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:25.122326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:25.125168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902d6d32c08b4eef86107109a1ed85a6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.136730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902d6d32c08b4eef86107109a1ed85a6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.190695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 878/1720] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:24 2022] DELETE /identity/v3/users/902d6d32c08b4eef86107109a1ed85a6 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:25.190695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:25.194508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:25.221161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e88e06-6cf9-4bbd-b153-608387f78c92 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:25.393588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:25.394549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:25.395770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:25.397781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] PATH_INFO: `/v3/projects/f778ec32c0c54a4f8cec642603154406` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:25.399320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f778ec32c0c54a4f8cec642603154406)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:25.403283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:25.443757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a7c4-77cf-4bc5-a033-87a7ebb68409 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:25.464186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:25.468043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:25.468043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:25.468043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] PATH_INFO: `/v3/projects/39c95e79fb574708aa18fac13b823ec4/users/b58adb149d71401d819bd32a3fac741d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:25.511294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c95e79fb574708aa18fac13b823ec4, user_id=b58adb149d71401d819bd32a3fac741d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:25.514619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcdfba-4d10-4205-b7d7-d9ea8e5cfbeb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:25.683386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 879/1721] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:25 2022] PUT /identity/v3/projects/39c95e79fb574708aa18fac13b823ec4/users/b58adb149d71401d819bd32a3fac741d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:25.683386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff7d4-fed2-4f8c-9e38-327e92df743e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:25.683386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff7d4-fed2-4f8c-9e38-327e92df743e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:25.683386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ff7d4-fed2-4f8c-9e38-327e92df743e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:25.688478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f778ec32c0c54a4f8cec642603154406', 'request_id': 'req-307233dd-c2a0-4add-8885-caa0de216745'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.729380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f778ec32c0c54a4f8cec642603154406', 'request_id': 'req-307233dd-c2a0-4add-8885-caa0de216745'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.756778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8e3ff7d4-fed2-4f8c-9e38-327e92df743e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:25.758086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8e3ff7d4-fed2-4f8c-9e38-327e92df743e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:25.777926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f778ec32c0c54a4f8cec642603154406', 'request_id': 'req-307233dd-c2a0-4add-8885-caa0de216745'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.868380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] The token cache is being invalidate because project f778ec32c0c54a4f8cec642603154406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:25.869062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.870022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-307233dd-c2a0-4add-8885-caa0de216745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:25.875098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 843/1722] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:25 2022] DELETE /identity/v3/projects/f778ec32c0c54a4f8cec642603154406 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:25.881639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:25.882008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:25.882346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:25.892793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 844/1723] 10.222.0.71 () {54 vars in 912 bytes} [Fri May 27 03:38:25 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:25.897075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:25.903848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.018345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 880/1724] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:26.019851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aad73-8119-40b5-8d5d-b109e0cfdf7e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.020148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aad73-8119-40b5-8d5d-b109e0cfdf7e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.020432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6aad73-8119-40b5-8d5d-b109e0cfdf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.122835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cf6aad73-8119-40b5-8d5d-b109e0cfdf7e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:26.127489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cf6aad73-8119-40b5-8d5d-b109e0cfdf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.156988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 881/1725] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:26.162963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ed80-48fe-45ae-9033-6254ef64c5b4 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.165586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ed80-48fe-45ae-9033-6254ef64c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.166490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c7ed80-48fe-45ae-9033-6254ef64c5b4 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.173496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 882/1726] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:38:26 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:26.180257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc564-a608-4726-95b7-29e8552f51e1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.180909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc564-a608-4726-95b7-29e8552f51e1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.181432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fc564-a608-4726-95b7-29e8552f51e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.191800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eaba2f-e71f-4bff-885b-fba7cc41c442 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:26.202582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:26.203739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.204169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.204586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.205571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:26.207791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:26.221367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 845/1727] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:26.222119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:26.224905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.235018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-595fc564-a608-4726-95b7-29e8552f51e1 None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:26.238217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-595fc564-a608-4726-95b7-29e8552f51e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.451207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 883/1728] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:26.452867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.453180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.453512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.522486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:26.523811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.539229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d42cc-01a6-41c0-9903-46a92b97541f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:26.546749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:26.548203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.548490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.548763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.553401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 884/1729] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:26.554603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:26.575034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:26.585048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:26.585668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4710-49fc-4b46-b885-eabab45c28fb None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:26.587238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c72d4-c761-4ccb-bb8a-7e7d76f0fee4 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:26.598591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:26.599576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.599860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.600175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] PATH_INFO: `/v3/projects/39c95e79fb574708aa18fac13b823ec4/users/b58adb149d71401d819bd32a3fac741d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.608352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39c95e79fb574708aa18fac13b823ec4, user_id=b58adb149d71401d819bd32a3fac741d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:26.610200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:26.628839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 846/1730] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:26.638589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.639073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.639341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.651826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 885/1731] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:26 2022] PUT /identity/v3/projects/39c95e79fb574708aa18fac13b823ec4/users/b58adb149d71401d819bd32a3fac741d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:26.669129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:26.694720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:26.697177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:26.847397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea5f38-d236-4949-8f3f-fed1b08be88d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:26.866669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:26.867801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.869586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.870003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:26.893865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:26.899592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e62679-2278-448f-a77e-b527e7b848ea service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:26.905914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 847/1732] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:26.907476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:26.926416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 886/1733] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:26.930423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:26.930846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:26.931223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.028111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] MFA Rules not processed for user `b58adb149d71401d819bd32a3fac741d`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:27.030257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.101547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6c99f-482c-42b5-92f9-b594f9bc47e2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:27.113569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:27.115984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:27.117955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:27.118453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.122309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:27.122820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:27.131688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:27.166829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 848/1734] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:27.168725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:27.173383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.211815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83457756-5d0f-4d8c-bc98-11fae5b2304b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:27.233208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:27.236259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:27.236561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:27.236849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] PATH_INFO: `/v3/projects/0101797b84c546ebacacac657d536912` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.244905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0101797b84c546ebacacac657d536912)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:27.247491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 887/1735] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:27.249104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:27.255009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:27.261097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.302597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3b440-2457-4865-88c6-e33a4307ee60 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:27.317473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:27.337088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:27.338098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:27.339315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:27.340438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.371881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:27.375004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:27.389765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 888/1736] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:27.391346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:27.405779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73231d06-25d2-4e68-a6cd-52dcd22a6742 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:27.412314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:27.413337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:27.413863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:27.414344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.415628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:27.419624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:27.486823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0101797b84c546ebacacac657d536912', 'request_id': 'req-852fd026-997b-4d80-8c7d-5689cbe698e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:27.497983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0101797b84c546ebacacac657d536912', 'request_id': 'req-852fd026-997b-4d80-8c7d-5689cbe698e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:27.518347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0101797b84c546ebacacac657d536912', 'request_id': 'req-852fd026-997b-4d80-8c7d-5689cbe698e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:27.561621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 889/1737] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:27 2022] POST /identity/v3/projects => generated 387 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:27.563053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:27.566237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.642972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] The token cache is being invalidate because project 0101797b84c546ebacacac657d536912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:27.643515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:27.649711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:27.655144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 849/1738] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:27 2022] DELETE /identity/v3/projects/0101797b84c546ebacacac657d536912 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:27.656238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:27.662607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.754398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59558238-9dc3-4822-b4d5-1d33d33a9408 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:27.766840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:27.767215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:27.767426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:27.767712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:27.771639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:27.892929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd026-997b-4d80-8c7d-5689cbe698e1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:28.004630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:28.009672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:28.036459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 890/1739] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:27 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:28.040288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:28.043304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:28.083987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:28.227611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f935e6c-bd8b-448b-b448-edc3b891daa7 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:28.237649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:28.238819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:28.239303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:28.239790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] PATH_INFO: `/v3/users/3aa03151bd5e4b1abfc12cf0e62f7b7c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:28.242691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aa03151bd5e4b1abfc12cf0e62f7b7c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:28.245570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:28.246730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:28.253421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:28.253421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:28.253421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:28.253421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:28.265291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:28.427869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 850/1740] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:27 2022] POST /identity/v3/users => generated 294 bytes in 772 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:28.432356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:28.488088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09e04-7152-4b52-9070-9cb36a2f0db4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:28.518328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:28.526260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:28.530690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:28.530990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:28.544411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:28.556982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:28.559110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aa03151bd5e4b1abfc12cf0e62f7b7c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:28.564942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aa03151bd5e4b1abfc12cf0e62f7b7c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:28.614474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 851/1741] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:28.615246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:28.625548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aa03151bd5e4b1abfc12cf0e62f7b7c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:28.625694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:28.694788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a24a952-119f-4fe3-a8e0-2e480f47574f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:28.711784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:28.712606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:28.712949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:28.716224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:28.724012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:28.757656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aa03151bd5e4b1abfc12cf0e62f7b7c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:28.758633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aa03151bd5e4b1abfc12cf0e62f7b7c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:28.825505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 891/1742] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:28 2022] DELETE /identity/v3/users/3aa03151bd5e4b1abfc12cf0e62f7b7c => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:28.825505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:28.830633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.001085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:29.006226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:29.062497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 852/1743] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:29.062497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:29.062793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e75abc-2187-4e7c-8e78-57c51de62614 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:29.062883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.081557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:29.085475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.085475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.085475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.085475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:29.095742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:29.114067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652f10d-05a0-4e7a-bcb7-382ced32c65f service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:29.125187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:29.126105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.126390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.126684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] PATH_INFO: `/v3/projects/b531bdc9089f4e4fa8aaf2ff14908708` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.133584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 892/1744] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:29.138139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b531bdc9089f4e4fa8aaf2ff14908708)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:29.138266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:29.138372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:29.159277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b69c93-0c89-4fbb-bfef-250922fbf608 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:29.176071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:29.177213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.177758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.178298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] PATH_INFO: `/v3/projects/43fb116b12224399917a7faf9f32aa62/users/e4557f91429e46d783ed44f57b2f85ab/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.224815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fb116b12224399917a7faf9f32aa62, user_id=e4557f91429e46d783ed44f57b2f85ab, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:29.227919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c898ba-0b04-474d-887d-29c5d7c193fd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:29.292955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 893/1745] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:29 2022] PUT /identity/v3/projects/43fb116b12224399917a7faf9f32aa62/users/e4557f91429e46d783ed44f57b2f85ab/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:29.294728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38de-b2f3-4ec3-92c0-325e381daad7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.295179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38de-b2f3-4ec3-92c0-325e381daad7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.295697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e38de-b2f3-4ec3-92c0-325e381daad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.340320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4e2e38de-b2f3-4ec3-92c0-325e381daad7 None None] MFA Rules not processed for user `eaf9c9fd3a5d4791907748df8bad800c`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:29.343962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4e2e38de-b2f3-4ec3-92c0-325e381daad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.357420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b531bdc9089f4e4fa8aaf2ff14908708', 'request_id': 'req-7e4fc404-3523-4ab1-9970-997648d030bf'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:29.381819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b531bdc9089f4e4fa8aaf2ff14908708', 'request_id': 'req-7e4fc404-3523-4ab1-9970-997648d030bf'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:29.418450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b531bdc9089f4e4fa8aaf2ff14908708', 'request_id': 'req-7e4fc404-3523-4ab1-9970-997648d030bf'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:29.448084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 894/1746] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:29.449970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.450503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.463274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.502002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] The token cache is being invalidate because project b531bdc9089f4e4fa8aaf2ff14908708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:29.502323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:29.503218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e4fc404-3523-4ab1-9970-997648d030bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:29.508633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 853/1747] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:29 2022] DELETE /identity/v3/projects/b531bdc9089f4e4fa8aaf2ff14908708 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:29.511601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:29.517959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:29.519409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:29.580633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] MFA Rules not processed for user `e4557f91429e46d783ed44f57b2f85ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:29.587242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.672136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:29.690514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.719821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:29.809203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 895/1748] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:29.810580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:29.819668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:29.935384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:30.036133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 854/1749] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:30.037625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:30.041310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:30.080419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389ff8-eb1a-434b-96b4-b4ce5f951063 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:30.090072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:30.091497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.092004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.095646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.097503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:30.107894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1073a8-2974-420c-ab9f-32bf79112de4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:30.114182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:30.120898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.120898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.120898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] PATH_INFO: `/v3/projects/fdb8d5aa1d2447aab523d3df511f005d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.120898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb8d5aa1d2447aab523d3df511f005d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:30.121839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fac21-b1d7-4e9f-880a-5c7913f790fa admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:30.127852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:30.364147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 855/1750] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:30.365784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f64ce-e8f8-411f-831e-cdcd2e9aa035 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.366142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f64ce-e8f8-411f-831e-cdcd2e9aa035 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.366562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f64ce-e8f8-411f-831e-cdcd2e9aa035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.379057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb8d5aa1d2447aab523d3df511f005d', 'request_id': 'req-0488b876-f23d-459c-9d9a-a5d2ffd91035'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:30.386998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb8d5aa1d2447aab523d3df511f005d', 'request_id': 'req-0488b876-f23d-459c-9d9a-a5d2ffd91035'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:30.429086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb8d5aa1d2447aab523d3df511f005d', 'request_id': 'req-0488b876-f23d-459c-9d9a-a5d2ffd91035'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:30.438472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c41f64ce-e8f8-411f-831e-cdcd2e9aa035 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:30.439740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c41f64ce-e8f8-411f-831e-cdcd2e9aa035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:30.529584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] The token cache is being invalidate because project fdb8d5aa1d2447aab523d3df511f005d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:30.535070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:30.535070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:30.535070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 896/1751] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:29 2022] DELETE /identity/v3/projects/fdb8d5aa1d2447aab523d3df511f005d => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:30.535070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:30.537086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:30.598521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 856/1752] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:30.603391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.603703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.603993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.649167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:30.662791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:30.690170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488b876-f23d-459c-9d9a-a5d2ffd91035 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:30.700449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 857/1753] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:30.700921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:30.755278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd015f-b010-45be-a6d1-82d5040c09a9 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:30.769737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:30.770226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:30.774570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.774570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.774570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.774570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:30.775003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.775003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.775003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.775881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:30.777245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:30.777770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:30.782946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ea392-1272-4638-9b54-0d5f1d3321cb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:30.824466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 858/1754] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:30.827552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:30.829366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:30.829856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:30.904924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:30.910627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:30.951285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 859/1755] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:30.951495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:30.974462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b985aa6-3fce-4c0a-953d-d74c259a6309 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:30.983292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 897/1756] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/users => generated 300 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:30.984179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.002548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.005077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.005403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.005705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.019024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.019172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de87c11-eb21-43ee-87fb-3d3cd4e140fd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:31.019314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.019399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.019399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.019399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.019399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.019651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:31.025744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.031868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.061643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 898/1757] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:31.062768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.091240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56fa1e-7ff6-4db2-8d44-1fdbdfa93cd9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:31.098163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.099003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.099290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.099634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.101693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.106684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.133214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 899/1758] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:31.142308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.170145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251bc95d-f547-4573-9aa1-13844a9ce64f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:31.182199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.184149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.184702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.198450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.198450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.198450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.216937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 860/1759] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:30 2022] POST /identity/v3/projects => generated 379 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:31.219167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.419339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 900/1760] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:31 2022] POST /identity/v3/projects => generated 369 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:31.423323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.560410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ac750-7263-430b-bd35-be2f65467d13 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:31.716750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a60d2-b9a7-4453-9869-c9e8e60720d9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:31.730703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:31.742591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.785610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.785610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.785610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.785610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.785610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.805568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:31.810158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:31.813993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:31.813993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] PATH_INFO: `/v3/projects/9d5801d54267462899d56483866c5bfc/users/d7240a1ba3334d13b745239c7429f3a4/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:31.868457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5801d54267462899d56483866c5bfc, user_id=d7240a1ba3334d13b745239c7429f3a4, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:31.872202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:31.947141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 901/1761] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:31 2022] POST /identity/v3/users => generated 290 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:31.950211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:31.983918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58e4efd-8da6-4845-b31f-4b093c4da54a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.059172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.059172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.059172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.059172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.059441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.059441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.228478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 861/1762] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:31 2022] PUT /identity/v3/projects/9d5801d54267462899d56483866c5bfc/users/d7240a1ba3334d13b745239c7429f3a4/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:32.230886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.336181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 902/1763] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:31 2022] POST /identity/v3/users => generated 285 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:32.337186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.349384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40414690-442b-4cee-87d9-6bda69552522 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.355131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.356456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.357045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.357567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.358698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.360627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.369913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b28d26-73ec-41b6-b206-ff35db5882a5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.383663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 862/1764] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:32.385176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.392005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.392005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.392005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.392005 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.392327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.392327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.405085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed002a23-64ec-4216-a502-211518e51afc admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.426021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.427261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.427847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.428328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.429960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.431934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 903/1765] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:32.434669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.435918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.449867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b48a3-9aea-4ecf-806a-8bb3dc2adc02 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.467338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 863/1766] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:32.468599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.473807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.474688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.475123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.475560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.476499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.478826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.501511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b484bc3c-8d2e-4436-8873-badba7e6e2fb admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.506056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.507134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 904/1767] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:32.507265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.507524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.507807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] PATH_INFO: `/v3/projects/9d5801d54267462899d56483866c5bfc/users/d7240a1ba3334d13b745239c7429f3a4/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.508034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.513111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5801d54267462899d56483866c5bfc, user_id=d7240a1ba3334d13b745239c7429f3a4, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.521356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8215c-6bca-4d93-acfa-151b9ec07062 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.531636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a11d4-bc6d-4697-b103-306634b447c5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.533347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.534238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.534680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.535225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.541139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.543574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.555703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 864/1768] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:32 2022] PUT /identity/v3/projects/9d5801d54267462899d56483866c5bfc/users/d7240a1ba3334d13b745239c7429f3a4/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:32.559692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a04d5-2c4e-4f69-915d-1258f33702c5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.560525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a04d5-2c4e-4f69-915d-1258f33702c5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.560928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a04d5-2c4e-4f69-915d-1258f33702c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.580633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 905/1769] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:32.580633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:32.599789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf125eb-a996-4e41-b8fb-28d30d501082 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:32.655020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9f6a04d5-2c4e-4f69-915d-1258f33702c5 None None] MFA Rules not processed for user `12207cbc940749eab50dc52e3319ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:32.660250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9f6a04d5-2c4e-4f69-915d-1258f33702c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:32.741159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:32.742440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.747586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.747586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] PATH_INFO: `/v3/projects/b890a86728c540bbb6d809b041ae0a95/users/0e6cb244d97c4b77aff5a17d3a19f46a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.811315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b890a86728c540bbb6d809b041ae0a95, user_id=0e6cb244d97c4b77aff5a17d3a19f46a, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:32.826457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:32.853201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 865/1770] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:32.853201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1272-4506-454d-a5b6-47b6ec16dde3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:32.853201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1272-4506-454d-a5b6-47b6ec16dde3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:32.853201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f1272-4506-454d-a5b6-47b6ec16dde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:32.920454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b68f1272-4506-454d-a5b6-47b6ec16dde3 None None] MFA Rules not processed for user `d7240a1ba3334d13b745239c7429f3a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:32.921756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b68f1272-4506-454d-a5b6-47b6ec16dde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:32.942522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 906/1771] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:32 2022] PUT /identity/v3/projects/b890a86728c540bbb6d809b041ae0a95/users/0e6cb244d97c4b77aff5a17d3a19f46a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:32.943858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:33.164724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8310d-f2cf-450d-8e1a-1301bdad27cf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:33.173502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:33.176183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:33.176702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:33.177175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] PATH_INFO: `/v3/projects/a06375d7658748139130b74c7a921c88/users/d18ab35a9dcf423488b2aa5b97f380e5/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:33.179739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 866/1772] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:33.183532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:33.184135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:33.184852 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:33.238783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] MFA Rules not processed for user `0e6cb244d97c4b77aff5a17d3a19f46a`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:33.241307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:33.251887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06375d7658748139130b74c7a921c88, user_id=d18ab35a9dcf423488b2aa5b97f380e5, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:33.268925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:33.384446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 867/1773] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:33.385818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:33.388289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:33.405567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:33.414508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 907/1774] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:32 2022] PUT /identity/v3/projects/a06375d7658748139130b74c7a921c88/users/d18ab35a9dcf423488b2aa5b97f380e5/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:33.415788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:33.537839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d9ebd7-3262-491f-9d5f-5fbd0fde6e19 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:33.546463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:33.547765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:33.548295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:33.548738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:33.549709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:33.552009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b51f1c-22b3-48f9-b0f9-7fb0d5903778 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:33.567378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25aba94-ab4d-4959-add5-baebb9c28741 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:33.655142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 908/1775] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:33 2022] POST /identity/v3/projects => generated 379 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:33.656727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:33.657083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:33.657606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:33.730748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] MFA Rules not processed for user `d18ab35a9dcf423488b2aa5b97f380e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:33.732024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:33.755090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:33.755090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:33.755090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:33.755090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:33.854841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 909/1776] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:33.857750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:33.988746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:33.995599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:34.013534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0021f0-b92a-46c4-9bc7-e8ffa7c01520 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:34.034785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:34.035719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:34.038216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:34.038216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:34.038216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:34.041775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 868/1777] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:34.042903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:34.043129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:34.075412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0990882-b488-43ae-bc17-c4a7b9c01cd9 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:34.090913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:34.091783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:34.092160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:34.092505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:34.093528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:34.096019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:34.277354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 910/1778] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:33 2022] POST /identity/v3/users => generated 296 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:34.277354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:34.277354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f523a-c5dc-49da-a0c0-6b604241b5e1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:34.277354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:34.277661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:34.277661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:34.277661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] PATH_INFO: `/v3/users/e4557f91429e46d783ed44f57b2f85ab` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:34.277661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4557f91429e46d783ed44f57b2f85ab)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:34.277661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:34.691204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 869/1779] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:34 2022] POST /identity/v3/projects => generated 369 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:34.693195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:34.865594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4557f91429e46d783ed44f57b2f85ab'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:34.865594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4557f91429e46d783ed44f57b2f85ab'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:34.873324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01536c01-1a77-4f6d-8a48-b6eeb9a51cc5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:34.885534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:34.888487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:34.888487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:34.888487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:34.888487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:34.890791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:34.906965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4557f91429e46d783ed44f57b2f85ab'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:34.924126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 870/1780] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:34.924984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:34.955468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79b4b5-b171-41ba-8aad-d2252a4c1786 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:34.966726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:34.967430 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:34.967722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:34.967997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:34.969925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:34.971976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f54e-87ce-440b-8120-04bb8334728e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.018471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4557f91429e46d783ed44f57b2f85ab'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:35.019121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4557f91429e46d783ed44f57b2f85ab'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:35.036231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 911/1781] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:34 2022] DELETE /identity/v3/users/e4557f91429e46d783ed44f57b2f85ab => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:35.037181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.038941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.100206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 871/1782] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:34 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:35.100206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.100206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.100206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.124526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:35.126002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.128501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7b03f-48a8-4b6e-8ba7-ae506b2fce61 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.133365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.134266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.134553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.134827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] PATH_INFO: `/v3/projects/eeff55abf253405994b438f4ccb308c1/users/669025b10073442497897bca42a5c8bd/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.135359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 872/1783] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:35.136888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.138420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.163261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeff55abf253405994b438f4ccb308c1, user_id=669025b10073442497897bca42a5c8bd, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.163480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de02e78-ded0-4984-a4d7-a769ee8dd4da None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.168671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.168836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.169562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.169722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.169995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.170805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.175094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.195347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 873/1784] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:35.195347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.195347 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.245307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 912/1785] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:35 2022] PUT /identity/v3/projects/eeff55abf253405994b438f4ccb308c1/users/669025b10073442497897bca42a5c8bd/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:35.245307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.260240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae88e1-2743-4383-9abf-2e67d2722f22 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.310464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d197c-bf5c-4aa6-9772-3eefe584aedf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.314462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.315028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.315153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.315391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.315670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.315908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.316256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.316461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] PATH_INFO: `/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d/users/cd898e6b01b74ea89f52eb4325f87714/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.330530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.330530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.342496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0e8e4b7634dcbb9a1474bd086cf8d, user_id=cd898e6b01b74ea89f52eb4325f87714, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.344461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.348630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 874/1786] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:35.350218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.370644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434b2d5-2c47-41f8-92e3-42e6fb389bea service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.376964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.377735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.380726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.380726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.380726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.381389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.393848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 875/1787] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:35.398926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.413514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2618f0-852e-46b5-be52-c57f427a06cd admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.418764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.419671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.420023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.420846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] PATH_INFO: `/v3/projects/eeff55abf253405994b438f4ccb308c1/users/669025b10073442497897bca42a5c8bd/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.424437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeff55abf253405994b438f4ccb308c1, user_id=669025b10073442497897bca42a5c8bd, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.427288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa257082-bcaa-4d95-9543-51748855202e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.440314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 876/1788] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:35 2022] PUT /identity/v3/projects/eeff55abf253405994b438f4ccb308c1/users/669025b10073442497897bca42a5c8bd/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:35.453340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.453340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.453340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.459844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 913/1789] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:35 2022] PUT /identity/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d/users/cd898e6b01b74ea89f52eb4325f87714/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:35.465057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.511400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] MFA Rules not processed for user `669025b10073442497897bca42a5c8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:35.512384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.556815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476aa04-a3da-4b29-89bd-de41e4a2aadb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.563889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.564430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.564717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.565023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.565793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.567400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.578834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 914/1790] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:35.582880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.594022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28b869-e9dc-4fab-8666-fba56260f54f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.595933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 877/1791] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:35.600901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.601867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.602155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.602435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] PATH_INFO: `/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d/users/cd898e6b01b74ea89f52eb4325f87714/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.604517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd0e8e4b7634dcbb9a1474bd086cf8d, user_id=cd898e6b01b74ea89f52eb4325f87714, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.607220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.607593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211a249-beff-4127-aceb-01e88224001c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.608654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.622431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 915/1792] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:35 2022] PUT /identity/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d/users/cd898e6b01b74ea89f52eb4325f87714/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:35.633955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.634326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.634685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.677225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:35.694427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] MFA Rules not processed for user `cd898e6b01b74ea89f52eb4325f87714`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:35.696101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.717317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6814a-f8b5-4bb8-8f44-fa535fdaddb1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.760247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:35.798493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.799501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 916/1793] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:35.799721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.800082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.800883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.809579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:35.811531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:35.824691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482dd40-cda6-4442-b9fd-d7d0a493122d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:35.828448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:35.829594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:35.829948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:35.830292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:35.842300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.843804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.856077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 917/1794] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:35.880708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:35.882320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:35.893838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 878/1795] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:36.030878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:36.033637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:36.147997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dddf8f-6da9-4725-8f63-3d14643c3467 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:36.154413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:36.155499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:36.155849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:36.156232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] PATH_INFO: `/v3/projects/43fb116b12224399917a7faf9f32aa62` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:36.157787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fb116b12224399917a7faf9f32aa62)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:36.160235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:36.342754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fb116b12224399917a7faf9f32aa62', 'request_id': 'req-0c56c29b-f087-49b2-ad50-2e55f67a7133'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.353746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fb116b12224399917a7faf9f32aa62', 'request_id': 'req-0c56c29b-f087-49b2-ad50-2e55f67a7133'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.363349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fb116b12224399917a7faf9f32aa62', 'request_id': 'req-0c56c29b-f087-49b2-ad50-2e55f67a7133'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.445470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] The token cache is being invalidate because project 43fb116b12224399917a7faf9f32aa62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:36.445854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.446557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.457713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 918/1796] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:36 2022] DELETE /identity/v3/projects/43fb116b12224399917a7faf9f32aa62 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:36.458995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:36.465589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc34bc-b1f7-4cc5-b82e-e51bf14a5c42 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:36.505242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:36.506811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:36.549786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:36.550686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:36.550972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:36.551337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] PATH_INFO: `/v3/users/d7240a1ba3334d13b745239c7429f3a4` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:36.553224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7240a1ba3334d13b745239c7429f3a4)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:36.559991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:36.599316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56c29b-f087-49b2-ad50-2e55f67a7133 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:36.602874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:36.603529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:36.603803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:36.604076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:36.606630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:36.674123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:36.675466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:36.687374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 919/1797] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:36.766361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7240a1ba3334d13b745239c7429f3a4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.778474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7240a1ba3334d13b745239c7429f3a4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.877455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7240a1ba3334d13b745239c7429f3a4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.878151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7240a1ba3334d13b745239c7429f3a4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.879057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-669017a1-4f42-44de-a43b-ba5d6d1966a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7240a1ba3334d13b745239c7429f3a4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:36.895498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 879/1798] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:36 2022] DELETE /identity/v3/users/d7240a1ba3334d13b745239c7429f3a4 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:37.759746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:38.042615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:38.044718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:38.083519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34319c-45c9-485f-9244-0a036828bc59 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:38.189347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:38.190437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:38.190742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:38.191023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] PATH_INFO: `/v3/projects/9d5801d54267462899d56483866c5bfc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:38.192289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5801d54267462899d56483866c5bfc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:38.194939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:38.433741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5801d54267462899d56483866c5bfc', 'request_id': 'req-df3dfa42-8191-4f3e-ad79-d775a97c8365'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:38.450723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5801d54267462899d56483866c5bfc', 'request_id': 'req-df3dfa42-8191-4f3e-ad79-d775a97c8365'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:38.470416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5801d54267462899d56483866c5bfc', 'request_id': 'req-df3dfa42-8191-4f3e-ad79-d775a97c8365'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:38.597011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] The token cache is being invalidate because project 9d5801d54267462899d56483866c5bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:38.597659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:38.598503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-df3dfa42-8191-4f3e-ad79-d775a97c8365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:38.603765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 920/1799] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:38 2022] DELETE /identity/v3/projects/9d5801d54267462899d56483866c5bfc => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:38.605778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:38.606287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:38.606415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:38.630483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:38.632061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:38.731805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 880/1800] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:38.739352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:38.739644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:38.739927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:38.768011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:38.769963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:38.781137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 921/1801] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:38.785166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:38.800388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d1f9e-a958-42f3-978a-cf6bd572f4a5 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:38.826991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:38.827682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:38.827959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:38.828266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:38.831133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:38.831648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:38.837486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:38.870733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 881/1802] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:38.872036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:38.881889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c087b0d-d2dd-4f73-b725-050fb30eb9ce None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:38.888971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:38.889897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:38.890517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:38.892700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:38.898988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:38.898988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:38.898988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:39.022406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 922/1803] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:38 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:39.024961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:39.045883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4654b-49e1-4692-9bf3-e99e107e7f28 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:39.152138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:39.152874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:39.153366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:39.153835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:39.159522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:39.159522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:39.285519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 882/1804] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:39 2022] POST /identity/v3/users => generated 294 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:39.288149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:39.312238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea50c69-c62d-4a23-af2d-9117056b214e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:39.324332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:39.325708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:39.333411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:39.334578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:39.336645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:39.339163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:39.367030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 923/1805] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:39.370579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:39.385747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a085d89b-e29c-4896-a779-bd49bbd1dc02 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:39.397867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:39.398748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:39.399198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:39.399619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:39.400509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:39.402509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c711a-0e3a-4794-bbc6-f8fec0624e3b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:39.441652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 883/1806] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:39.442936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:39.457775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a1c96-a06c-4044-9e51-7805146d25ee admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:39.469884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:39.470804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:39.471088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:39.471364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] PATH_INFO: `/v3/projects/b7c46aea94ad46ad88d8d927e26de536/users/58b0d81482364cc698460205bb19d2db/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:39.529470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c46aea94ad46ad88d8d927e26de536, user_id=58b0d81482364cc698460205bb19d2db, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:39.532133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:40.668467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 924/1807] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:39 2022] PUT /identity/v3/projects/b7c46aea94ad46ad88d8d927e26de536/users/58b0d81482364cc698460205bb19d2db/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 1226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:40.679562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:40.680201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:40.680201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:40.726042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] MFA Rules not processed for user `58b0d81482364cc698460205bb19d2db`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:40.727941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:40.850839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 884/1808] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:40.856060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:41.033368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99b069-f9db-4b40-9d76-79ecd7a31683 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:41.039359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:41.040044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.040330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.040610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.041353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:41.044732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:41.165619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 925/1809] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:40 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:41.170292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:41.188393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587364a-88b6-4fa1-bf86-34ff6b145d01 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:41.317989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:41.318846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.319465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.319921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.321136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:41.333609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:41.423029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 885/1810] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:41 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:41.423891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:41.439452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda4de6-5715-483d-be31-9ce6d79b1c16 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:41.460911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:41.462193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.462696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.463249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.466343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:41.471765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:41.511913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:41.518681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 926/1811] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:41.542739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc5f0a-bf70-472a-ac80-b6f7e882ae88 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:41.567122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:41.573405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.579831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.579831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.581983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:41.585567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c149c48-d98e-480f-9026-828b8ea6db4c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:41.619416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 886/1812] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:41.621457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:41.632293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1fdfb-be2d-4e86-a524-e9ad623f96a8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:41.659905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:41.661032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.661335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.661763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] PATH_INFO: `/v3/projects/5847cc8f5e70464a8148025e73725836/users/ec5979fc4ea9403faabfc1b988d03554/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.726289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5847cc8f5e70464a8148025e73725836, user_id=ec5979fc4ea9403faabfc1b988d03554, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:41.726969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:41.727335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc273d-25be-4e96-a7d9-f41775dd47f1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:41.891720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278456c-aa88-4bc8-9e90-3a2c7026feac None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.892458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278456c-aa88-4bc8-9e90-3a2c7026feac None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.893360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278456c-aa88-4bc8-9e90-3a2c7026feac None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.896219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:41.900880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 887/1813] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:38:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:41.904493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 927/1814] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:41 2022] PUT /identity/v3/projects/5847cc8f5e70464a8148025e73725836/users/ec5979fc4ea9403faabfc1b988d03554/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:41.918449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.919269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.920493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.922934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:41.923850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:41.926575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:41.987282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:41.988777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.030755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] MFA Rules not processed for user `ec5979fc4ea9403faabfc1b988d03554`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:42.033529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.148155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 928/1815] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:42.155324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 888/1816] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:42.163185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:42.170486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:42.172129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.189166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1319b8e-0f49-46db-ab96-523b4c1af91d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:42.203668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:42.203668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.203668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.203668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.216311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:42.218174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:42.255253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9686a60-e338-4d99-ba09-c8761750df16 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:42.255344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 889/1817] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:42.269497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:42.270190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.270481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.270760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.271478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:42.274768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb10c1e-305d-4471-a5d9-d6f394fd16dc admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:42.281668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:42.284241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.305580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc20637-de08-4441-b8da-9e67c2ca2560 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:42.322753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:42.334130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.334130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.334130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] PATH_INFO: `/v3/users/8411fed2541f46ffaf162d4d826db33f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.334130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8411fed2541f46ffaf162d4d826db33f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:42.334130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:42.392997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 929/1818] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:42 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:42.397751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd337b6c-acfe-44c0-a951-8a26d8524006 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.406804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd337b6c-acfe-44c0-a951-8a26d8524006 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.407243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd337b6c-acfe-44c0-a951-8a26d8524006 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.408755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 930/1819] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:38:42 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:38:42.420830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd337b6c-acfe-44c0-a951-8a26d8524006 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:42.644328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd337b6c-acfe-44c0-a951-8a26d8524006 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:42.653651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:42.653651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.653651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.653651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.654020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:42.656814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8ed09-a9a3-430b-9616-829593398cf0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:42.684920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8411fed2541f46ffaf162d4d826db33f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:42.713288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8411fed2541f46ffaf162d4d826db33f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:42.757160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 931/1820] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:42 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:42.757160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee830a-609b-46ad-979b-7d113aaba5ab None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.757160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee830a-609b-46ad-979b-7d113aaba5ab None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.757160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee830a-609b-46ad-979b-7d113aaba5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.804544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-55ee830a-609b-46ad-979b-7d113aaba5ab None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:42.806167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-55ee830a-609b-46ad-979b-7d113aaba5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.816586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8411fed2541f46ffaf162d4d826db33f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:42.820473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8411fed2541f46ffaf162d4d826db33f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:42.820473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8411fed2541f46ffaf162d4d826db33f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:42.849060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 890/1821] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:42 2022] DELETE /identity/v3/users/8411fed2541f46ffaf162d4d826db33f => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:42.849060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:42.849060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:42.937154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 932/1822] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:42.945993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.950392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.950392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.972287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fad60d-afe2-4f32-8866-1d55a18e0266 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:42.989625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:42.990378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:42.990679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:42.991111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:42.991891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:42.993567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.000398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:43.003682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:43.025594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 891/1823] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:43.025594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.025753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 933/1824] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:43.025824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:43.034462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.046173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6077f-cc03-4d3b-8e5c-ae507364fe55 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.051167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.052434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.052868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.053338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] PATH_INFO: `/v3/projects/aa3764f64be84e10ae004f2f4abfc995/users/2650b83d67694811951a514c4ee303eb/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.078348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3764f64be84e10ae004f2f4abfc995, user_id=2650b83d67694811951a514c4ee303eb, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:43.080644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.166271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeeb30-39b6-4eea-825b-2e6215a1ee06 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.173114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.174210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.174568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.174838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.191392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:43.193088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.207385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 892/1825] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:43.208171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.209911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:43.275046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 934/1826] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:43 2022] PUT /identity/v3/projects/aa3764f64be84e10ae004f2f4abfc995/users/2650b83d67694811951a514c4ee303eb/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:43.279431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.322922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c30bf-e699-4903-95c0-eaaf9d8e94fc service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.437999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7d5b3-ded3-469a-9fed-042679d6f08a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.446264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.447085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.450582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.450582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.450804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.451641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.452175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.454502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.455890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:43.457808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.474779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:43.477230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433668b-4e60-49c1-a594-b8f2c90dee95 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.483236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 935/1827] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:43.484420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.495324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 893/1828] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:43.497051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16d5bf-6bae-4998-8148-661b58d31136 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.502408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.503477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.503852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.504137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] PATH_INFO: `/v3/projects/aa3764f64be84e10ae004f2f4abfc995/users/2650b83d67694811951a514c4ee303eb/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.507100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3764f64be84e10ae004f2f4abfc995, user_id=2650b83d67694811951a514c4ee303eb, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:43.517595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:43.528718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 936/1829] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:43 2022] PUT /identity/v3/projects/aa3764f64be84e10ae004f2f4abfc995/users/2650b83d67694811951a514c4ee303eb/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:43.542763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.542763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.542763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.581810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] MFA Rules not processed for user `2650b83d67694811951a514c4ee303eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:43.583039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:43.760142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 894/1830] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:43.861865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:43.863861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:43.960605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b3ec1-1abf-4b46-96a2-5cbe27a6a2c9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:43.971108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:43.971831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:43.972125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:43.972409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:43.992197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:44.003185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:44.028277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 937/1831] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:44.312240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:44.315290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:44.405193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34954b20-6413-46fe-b16e-0276150ca515 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:44.409976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:44.410775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:44.411060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:44.411340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] PATH_INFO: `/v3/projects/2b7705badd234d2fadcc2690a4d01078` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:44.412517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7705badd234d2fadcc2690a4d01078)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:44.414477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:44.583561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7705badd234d2fadcc2690a4d01078', 'request_id': 'req-51987a58-b614-49de-b58b-dd68c721294a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:44.592454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7705badd234d2fadcc2690a4d01078', 'request_id': 'req-51987a58-b614-49de-b58b-dd68c721294a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:44.603317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7705badd234d2fadcc2690a4d01078', 'request_id': 'req-51987a58-b614-49de-b58b-dd68c721294a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:44.708128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:44.710201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:44.732098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4201c9c-861f-4053-851e-5f80a3759ee2 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:44.748834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] The token cache is being invalidate because project 2b7705badd234d2fadcc2690a4d01078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:44.749675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:44.751162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:44.757057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 895/1832] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:44 2022] DELETE /identity/v3/projects/2b7705badd234d2fadcc2690a4d01078 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:44.762244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:44.764002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:44.856111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:44.857242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:44.857554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:44.857854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] PATH_INFO: `/v3/users/d18ab35a9dcf423488b2aa5b97f380e5` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:44.859156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18ab35a9dcf423488b2aa5b97f380e5)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:44.861444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:44.880103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51987a58-b614-49de-b58b-dd68c721294a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:44.889701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:44.890701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:44.891061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:44.891433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] PATH_INFO: `/v3/users/b58adb149d71401d819bd32a3fac741d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:44.892768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58adb149d71401d819bd32a3fac741d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:44.895116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:44.895578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:45.134861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18ab35a9dcf423488b2aa5b97f380e5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.140198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18ab35a9dcf423488b2aa5b97f380e5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.146548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58adb149d71401d819bd32a3fac741d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.153162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18ab35a9dcf423488b2aa5b97f380e5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.178242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58adb149d71401d819bd32a3fac741d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.272039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18ab35a9dcf423488b2aa5b97f380e5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.272677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5e87de64-53ff-4967-a247-c6172c0ed950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18ab35a9dcf423488b2aa5b97f380e5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.287650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 938/1833] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:44 2022] DELETE /identity/v3/users/d18ab35a9dcf423488b2aa5b97f380e5 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:45.292691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:45.292985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:45.293347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:45.310537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:45.311807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:45.372402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 939/1834] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:45.382512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:45.384035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:45.392076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58adb149d71401d819bd32a3fac741d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.392860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58adb149d71401d819bd32a3fac741d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.393604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58adb149d71401d819bd32a3fac741d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:45.416015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 896/1835] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:44 2022] DELETE /identity/v3/users/b58adb149d71401d819bd32a3fac741d => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:45.469095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79b5d4-81a1-491f-8a75-00e3474e2335 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:45.530496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:45.531428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:45.531428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:45.531698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:45.551152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:45.623939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:45.626276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:45.626869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:45.628334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:45.637756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 940/1836] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:45.691596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe2eac-393c-4c0c-8a10-cdb9d519c60d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:45.696441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:45.697221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:45.697683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:45.698920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:45.701201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:45.793115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:45.794744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fbcb5-1c72-4d25-9d00-68200c97f75e service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:45.807720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 897/1837] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:45.954208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:46.174836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:46.177184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:46.195885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474501cf-4142-4119-936c-69147665a7ff service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:46.218687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:46.219655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:46.219943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:46.220266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] PATH_INFO: `/v3/projects/39c95e79fb574708aa18fac13b823ec4` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:46.223313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39c95e79fb574708aa18fac13b823ec4)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:46.239692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:46.426343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39c95e79fb574708aa18fac13b823ec4', 'request_id': 'req-3c061fb4-ede8-4a05-89df-41b79a21c8f0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:46.438953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39c95e79fb574708aa18fac13b823ec4', 'request_id': 'req-3c061fb4-ede8-4a05-89df-41b79a21c8f0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:46.460015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39c95e79fb574708aa18fac13b823ec4', 'request_id': 'req-3c061fb4-ede8-4a05-89df-41b79a21c8f0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:46.546292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] The token cache is being invalidate because project 39c95e79fb574708aa18fac13b823ec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:46.546731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:46.547549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c061fb4-ede8-4a05-89df-41b79a21c8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:46.550154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 941/1838] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:46 2022] DELETE /identity/v3/projects/39c95e79fb574708aa18fac13b823ec4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:46.555004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:46.555591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:46.555591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:46.582944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:46.584451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:46.676362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 898/1839] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:46.685650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:46.686055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:46.686367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:46.709097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:46.712362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:46.728335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 942/1840] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:46.731374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:46.742097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492ac8e-71e3-4758-8607-6786a4289cac None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:46.748368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:46.749349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:46.757843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:46.757843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:46.757843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:46.757843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:46.757843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:46.782081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 899/1841] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:46.790589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:46.804305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f2b86-c18d-4f34-9a9c-70e8782ab3c2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:46.826973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:46.827659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:46.828423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:46.828735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:46.829638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:46.831620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:46.982190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 943/1842] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:46 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:46.984218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.000568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dc6ef8-8256-4bea-994f-aad970581b67 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.068843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.069654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.069947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.070222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.070991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.073453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.200282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.203451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:47.225756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 900/1843] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:46 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:47.228313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6502db4-6daf-43ba-a9e2-ef19faf2f6f5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.229406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.247294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42820270-f794-4a7c-bf91-a5a177d09810 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.247612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.247612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.247612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.247612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] PATH_INFO: `/v3/projects/a06375d7658748139130b74c7a921c88` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.247935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06375d7658748139130b74c7a921c88)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.250517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.254115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.254870 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.255159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.255506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.256360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.257786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.278988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 901/1844] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:47.281717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.295170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b2346c-ddaf-4e40-b97e-8daee76a868e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.302272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.302946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.303229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.304726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.304726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.305918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.329814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 902/1845] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:47.334735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.352708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ff989-6b18-4dec-9999-d65cc5f9bef7 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.358798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.359694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.359981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.360259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] PATH_INFO: `/v3/projects/0b4cf1e310344d109befa3efcf13a1cf/users/ea9826c2f78e463db0ed92ad10d2d6ac/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.382222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b4cf1e310344d109befa3efcf13a1cf, user_id=ea9826c2f78e463db0ed92ad10d2d6ac, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.385157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631de4c-2243-47bf-a53d-3fa28799bb36 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.489534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 903/1846] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:47 2022] PUT /identity/v3/projects/0b4cf1e310344d109befa3efcf13a1cf/users/ea9826c2f78e463db0ed92ad10d2d6ac/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:47.505739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.506774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.506993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.508628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06375d7658748139130b74c7a921c88', 'request_id': 'req-6458283c-9413-42cd-84fb-96fb88c69995'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:47.546106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06375d7658748139130b74c7a921c88', 'request_id': 'req-6458283c-9413-42cd-84fb-96fb88c69995'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:47.558990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06375d7658748139130b74c7a921c88', 'request_id': 'req-6458283c-9413-42cd-84fb-96fb88c69995'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:47.572002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] MFA Rules not processed for user `ea9826c2f78e463db0ed92ad10d2d6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:47.574329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:47.641583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] The token cache is being invalidate because project a06375d7658748139130b74c7a921c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:47.641878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:47.643426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:47.645956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 944/1847] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:47 2022] DELETE /identity/v3/projects/a06375d7658748139130b74c7a921c88 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:47.651093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.653133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:47.700898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 904/1848] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:47.706911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:47.708353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:47.737589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458283c-9413-42cd-84fb-96fb88c69995 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.828985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.830128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.830415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.830701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] PATH_INFO: `/v3/users/cd898e6b01b74ea89f52eb4325f87714` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.833150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd898e6b01b74ea89f52eb4325f87714)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.836038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.843301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad77f18-457e-4bda-8f65-b1e64176493c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:47.851372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:47.852117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:47.852561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:47.852857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:47.853592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:47.857091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:47.997649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 905/1849] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:47 2022] POST /identity/v3/projects => generated 381 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:48.001769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.072587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75effacf-68b5-404e-a73d-1e05d0a4818f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.077807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.078481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.078765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.079040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.079731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.081680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:48.106768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd898e6b01b74ea89f52eb4325f87714'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:48.107511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd898e6b01b74ea89f52eb4325f87714'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:48.121502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd898e6b01b74ea89f52eb4325f87714'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:48.264596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 906/1850] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:48 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:48.268844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.282379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4bef4-0ad4-4836-90ab-75b2ce22394a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.287539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.288318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.288677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.289297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.291015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.293299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:48.310303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 907/1851] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:48.315064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd898e6b01b74ea89f52eb4325f87714'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:48.315601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.316402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd898e6b01b74ea89f52eb4325f87714'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:48.327537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0a6b-6a58-4a16-bc83-bd56b72dfa8b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.333851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.335058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.335485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.335927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] PATH_INFO: `/v3/projects/c861f34efa284d05b9f28fe6e2620894/users/5d63f29b4f3149eda56b23d1af73fcf3/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.349415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 945/1852] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:47 2022] DELETE /identity/v3/users/cd898e6b01b74ea89f52eb4325f87714 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:48.364873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861f34efa284d05b9f28fe6e2620894, user_id=5d63f29b4f3149eda56b23d1af73fcf3, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.375877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:48.487889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 908/1853] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:48 2022] PUT /identity/v3/projects/c861f34efa284d05b9f28fe6e2620894/users/5d63f29b4f3149eda56b23d1af73fcf3/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:48.495841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.499976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:48.585998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01fe97-4a91-47ba-8438-236fccbfa2dd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.661004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.661404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.661694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.661976 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.662790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.664510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9924fa-13f6-4ce5-98ce-176ee72ba3bb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:48.675757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 946/1854] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:48.679976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.696592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b8b1-48ea-4c82-b203-0304f9c69897 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.710749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.712322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.712824 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.715499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] PATH_INFO: `/v3/projects/c861f34efa284d05b9f28fe6e2620894/users/5d63f29b4f3149eda56b23d1af73fcf3/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.720499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c861f34efa284d05b9f28fe6e2620894, user_id=5d63f29b4f3149eda56b23d1af73fcf3, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.731480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:48.766455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 909/1855] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:48 2022] PUT /identity/v3/projects/c861f34efa284d05b9f28fe6e2620894/users/5d63f29b4f3149eda56b23d1af73fcf3/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:48.781235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.781479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.781952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.817532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] MFA Rules not processed for user `5d63f29b4f3149eda56b23d1af73fcf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:48.818765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:48.856002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.858206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:48.939116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 947/1856] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:48.949207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f78408-7f23-4982-bbfa-85e7d88411c6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:48.953555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:48.954468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:48.955565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:48.955688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:48.955916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:48.956277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] PATH_INFO: `/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:48.958033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd0e8e4b7634dcbb9a1474bd086cf8d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:48.960252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.022264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12474aa6-2145-42f3-a49f-60404c6eb632 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.026413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.027101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.027393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.027672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.037187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.038659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.049347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 948/1857] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:49.224303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd0e8e4b7634dcbb9a1474bd086cf8d', 'request_id': 'req-fa68703c-87b1-4076-a2fb-1b15ec377a9a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:49.230944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd0e8e4b7634dcbb9a1474bd086cf8d', 'request_id': 'req-fa68703c-87b1-4076-a2fb-1b15ec377a9a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:49.236666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd0e8e4b7634dcbb9a1474bd086cf8d', 'request_id': 'req-fa68703c-87b1-4076-a2fb-1b15ec377a9a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:49.289893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:49.291303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:49.302407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390be7ea-d810-4b75-9b28-5cb523d1e410 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.351324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.352149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.353527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:49.354007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.354366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.356381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:49.398779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] The token cache is being invalidate because project 9dd0e8e4b7634dcbb9a1474bd086cf8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:49.399271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:49.400023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fa68703c-87b1-4076-a2fb-1b15ec377a9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:49.403389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 910/1858] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:48 2022] DELETE /identity/v3/projects/9dd0e8e4b7634dcbb9a1474bd086cf8d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:49.409828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.410643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.411124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.420446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.422816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd1d2c0-4f86-4ab5-b5fa-58108fe98aaa service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.433430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 949/1859] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:49.436446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:49.437731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:49.529958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 911/1860] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:49.537843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.538404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.538752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.558973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:49.560171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:49.568422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 950/1861] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:49.572778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:49.582940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bf00a-86b3-43bb-8b48-0a5c73008178 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.587923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.588725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.589007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.589319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.590101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:49.590415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.592043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.605067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 912/1862] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:49.609726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:49.620452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ed575-1d3f-46a4-9dce-cfd4c4d4f5c7 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.627018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.630106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.630106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.630106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.630106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.632606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.648001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:49.649901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:49.663868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945c0ee-c674-44fc-8306-e1b3c34978c7 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.668979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.669905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.670191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.670711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] PATH_INFO: `/v3/users/0e6cb244d97c4b77aff5a17d3a19f46a` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.671847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6cb244d97c4b77aff5a17d3a19f46a)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.673950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:49.831724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 951/1863] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:49 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:49.834459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:49.910949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ec551-2318-4457-9b47-21006b1aa393 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:49.917465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:49.918910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:49.919200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:49.919481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:49.920185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:49.922238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.009652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6cb244d97c4b77aff5a17d3a19f46a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.024652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6cb244d97c4b77aff5a17d3a19f46a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.050761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 952/1864] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:49 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:50.054466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.066464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa7100-6587-4864-b041-0e5f9e6a440e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.072095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.073377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.073534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.074610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.074923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.076931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.090047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 953/1865] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:50.093546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.110397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e185b-3277-48a8-88fe-b05bdb37a61b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.116060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.116911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.117336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.117658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.118628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.120573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.133676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 954/1866] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:50.138140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6cb244d97c4b77aff5a17d3a19f46a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.138928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6cb244d97c4b77aff5a17d3a19f46a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.139576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9854ebfa-effa-4e11-95a4-6b8e7883e599 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6cb244d97c4b77aff5a17d3a19f46a'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.149902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.152488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.168851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 913/1867] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:49 2022] DELETE /identity/v3/users/0e6cb244d97c4b77aff5a17d3a19f46a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:50.173943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.174306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.174804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.175089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52f82e-290e-4828-9f47-61261e63d029 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.232443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:50.233919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.293300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.295272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.295562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.295870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] PATH_INFO: `/v3/projects/4b6cd4135370437ba2566aafd2f024ab/users/e05e5abccc214656866f94424a84ec53/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.313724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b6cd4135370437ba2566aafd2f024ab, user_id=e05e5abccc214656866f94424a84ec53, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.317581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.357907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 914/1868] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:50.358762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.360120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.373152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19f220-6a88-41e0-a76d-36349f9dd0ad None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.378250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.379147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.379455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.379736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] PATH_INFO: `/v3/users/ea9826c2f78e463db0ed92ad10d2d6ac` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.380972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea9826c2f78e463db0ed92ad10d2d6ac)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.382992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.412413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 955/1869] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:50 2022] PUT /identity/v3/projects/4b6cd4135370437ba2566aafd2f024ab/users/e05e5abccc214656866f94424a84ec53/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:50.422794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.424530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.483185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d3290-b3f8-46dd-b689-4c5c2bf4bce7 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.487655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.488306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.488586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.488859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.558196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.559651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce4b28-e9a5-464e-b7a7-929f0510a89b service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.573658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 956/1870] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:50.573658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.574051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.574339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.603210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] MFA Rules not processed for user `e05e5abccc214656866f94424a84ec53`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:50.605302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.670186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 957/1871] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:50.676732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.688218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fd597-4fc2-4a1c-b4e5-dba493625b2e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.693034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:50.693894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.694074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.694351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.695039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:50.696969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:50.727704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea9826c2f78e463db0ed92ad10d2d6ac'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.742376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea9826c2f78e463db0ed92ad10d2d6ac'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.811812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:50.813081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea9826c2f78e463db0ed92ad10d2d6ac'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.814086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea9826c2f78e463db0ed92ad10d2d6ac'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.819971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e13c33a-437c-4380-9ba4-233ed81ff536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea9826c2f78e463db0ed92ad10d2d6ac'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:50.820107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 958/1872] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:50 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:50.827132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.831595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.839941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 915/1873] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:50 2022] DELETE /identity/v3/users/ea9826c2f78e463db0ed92ad10d2d6ac => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:50.846654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:50.851913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:50.851913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:50.874806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:50.876487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:50.928788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07f50-2df4-4b20-8c45-7e915c75af9b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:50.945475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 916/1874] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:50.962231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:50.964335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.000266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.000952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.001234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.001533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.002224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.004210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.031657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815992-288d-4c69-b7b7-c3d95d856dc1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.035279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.035916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.036195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.036464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.045560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.046983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.056193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 917/1875] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:51.125468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 959/1876] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:50 2022] POST /identity/v3/users => generated 299 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:51.126637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.137398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.140880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f5161-777f-4a1d-b8fa-60433f2bf7e6 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.143831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.161454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.162401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.162689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.163122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.164258 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.165923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.169049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ed282-df83-4c87-88a9-0e390cdf126f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.180315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.183201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.183811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.184278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] PATH_INFO: `/v3/projects/b890a86728c540bbb6d809b041ae0a95` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.185790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b890a86728c540bbb6d809b041ae0a95)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.188137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.203279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 918/1877] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:51.204383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.218907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19494b05-3ea7-48b9-8f3f-0d3e008d0fea admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.226947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.227926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.228212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.228510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] PATH_INFO: `/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68/users/0467796b791a4f18b2f7f74694da24df/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.244409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8340bc6cdfd44d3bb3fad80ad6d1c68, user_id=0467796b791a4f18b2f7f74694da24df, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.248258 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.366096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 919/1878] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:51 2022] PUT /identity/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68/users/0467796b791a4f18b2f7f74694da24df/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:51.370748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.393921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b890a86728c540bbb6d809b041ae0a95', 'request_id': 'req-e9c1ebd2-4732-4000-a4c9-252f933e06e0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:51.401558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b890a86728c540bbb6d809b041ae0a95', 'request_id': 'req-e9c1ebd2-4732-4000-a4c9-252f933e06e0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:51.411074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b890a86728c540bbb6d809b041ae0a95', 'request_id': 'req-e9c1ebd2-4732-4000-a4c9-252f933e06e0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:51.472573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee78c6-8efe-4381-938d-84d597ce1883 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.539239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] The token cache is being invalidate because project b890a86728c540bbb6d809b041ae0a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:51.539775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:51.540419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:51.542793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 960/1879] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:51 2022] DELETE /identity/v3/projects/b890a86728c540bbb6d809b041ae0a95 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:51.546824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.548479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.567460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.568294 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.568687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.569071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.570062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.574664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.592264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 920/1880] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:51.597434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.600066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.619839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244daeed-8e42-4083-a437-b0f2ec7ee7e0 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.626829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.631491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.631491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.631491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] PATH_INFO: `/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68/users/0467796b791a4f18b2f7f74694da24df/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.631491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8340bc6cdfd44d3bb3fad80ad6d1c68, user_id=0467796b791a4f18b2f7f74694da24df, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.635972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38178a51-a418-4a1f-9d8b-51635bf14195 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.657352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 921/1881] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:51 2022] PUT /identity/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68/users/0467796b791a4f18b2f7f74694da24df/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:51.668276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.668595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.668883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.681478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1ebd2-4732-4000-a4c9-252f933e06e0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.704821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] MFA Rules not processed for user `0467796b791a4f18b2f7f74694da24df`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:51.705708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.767104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.768402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.768847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.769536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] PATH_INFO: `/v3/users/669025b10073442497897bca42a5c8bd` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.770940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=669025b10073442497897bca42a5c8bd)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.772920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:51.820395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 922/1882] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:51.821619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:51.828107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:51.858929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac525f-9509-4fc7-894b-2c291f0458a9 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:51.871887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:51.874305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:51.874572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:51.874857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] PATH_INFO: `/v3/projects/0b4cf1e310344d109befa3efcf13a1cf` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:51.876344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b4cf1e310344d109befa3efcf13a1cf)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:51.878656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:52.234052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669025b10073442497897bca42a5c8bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.235787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669025b10073442497897bca42a5c8bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.243843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b4cf1e310344d109befa3efcf13a1cf', 'request_id': 'req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.251391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b4cf1e310344d109befa3efcf13a1cf', 'request_id': 'req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.253069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669025b10073442497897bca42a5c8bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.257066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b4cf1e310344d109befa3efcf13a1cf', 'request_id': 'req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.353669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669025b10073442497897bca42a5c8bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.354954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669025b10073442497897bca42a5c8bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.368387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 961/1883] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:51 2022] DELETE /identity/v3/users/669025b10073442497897bca42a5c8bd => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:38:52.370631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:52.372995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.435673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdddcdd-e6b7-4953-b163-7099666c1c7f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:52.440364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:52.441368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:52.441903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:52.442356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:52.445166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.465997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] The token cache is being invalidate because project 0b4cf1e310344d109befa3efcf13a1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:52.466318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.467021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.469216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 923/1884] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:51 2022] DELETE /identity/v3/projects/0b4cf1e310344d109befa3efcf13a1cf => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:52.471976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:52.472199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.530618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:52.533872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:52.550418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 962/1885] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:52.554034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:52.556232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.568572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4138dd-ea8b-4a31-8ae0-e32866c3ad76 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:52.575334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:52.576212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:52.578909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:52.578909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:52.591314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.647949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002da1b0-1419-400e-a323-5738223cda73 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:52.653849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:52.654793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:52.655167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:52.655443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] PATH_INFO: `/v3/users/5d63f29b4f3149eda56b23d1af73fcf3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:52.656820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d63f29b4f3149eda56b23d1af73fcf3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:52.658786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:52.658883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:52.660342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:52.670457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 924/1886] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:52.671222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:52.672514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:52.686560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473cff-a15a-42e3-a718-ca340ea942aa service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:52.692230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:52.693355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:52.693575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:52.693858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] PATH_INFO: `/v3/users/e05e5abccc214656866f94424a84ec53` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:52.705579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e05e5abccc214656866f94424a84ec53)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:52.710183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:52.725319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:INSERT=11,keystone:DELETE=1,keystone:SELECT=88 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:52.913215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d63f29b4f3149eda56b23d1af73fcf3'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.913925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d63f29b4f3149eda56b23d1af73fcf3'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.929247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d63f29b4f3149eda56b23d1af73fcf3'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.953776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e05e5abccc214656866f94424a84ec53'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:52.966691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e05e5abccc214656866f94424a84ec53'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.044705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d63f29b4f3149eda56b23d1af73fcf3'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.045400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d63f29b4f3149eda56b23d1af73fcf3'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.061631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 963/1887] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:52 2022] DELETE /identity/v3/users/5d63f29b4f3149eda56b23d1af73fcf3 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:53.062504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.063896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.136949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa07a586-d058-498d-9ebd-54075bb79732 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:53.142927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:53.143803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.144094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.144371 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] PATH_INFO: `/v3/projects/eeff55abf253405994b438f4ccb308c1` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.145635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeff55abf253405994b438f4ccb308c1)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:53.147542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:53.222578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e05e5abccc214656866f94424a84ec53'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.223270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e05e5abccc214656866f94424a84ec53'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.223939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7e21f892-7583-448d-84e1-b731e0eda218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e05e5abccc214656866f94424a84ec53'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.237659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 925/1888] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:52 2022] DELETE /identity/v3/users/e05e5abccc214656866f94424a84ec53 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:53.242342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.242662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.242967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.263274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:53.264560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.325874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 926/1889] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:53.347737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.349233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.354726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeff55abf253405994b438f4ccb308c1', 'request_id': 'req-5499b54c-3e9c-4441-b9bc-e8ed6314be14'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.369212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeff55abf253405994b438f4ccb308c1', 'request_id': 'req-5499b54c-3e9c-4441-b9bc-e8ed6314be14'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.379290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeff55abf253405994b438f4ccb308c1', 'request_id': 'req-5499b54c-3e9c-4441-b9bc-e8ed6314be14'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.419327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae3c2e-7f24-4d78-9912-195cf300d3ce None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:53.490120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] The token cache is being invalidate because project eeff55abf253405994b438f4ccb308c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:53.490120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.490120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-5499b54c-3e9c-4441-b9bc-e8ed6314be14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.496155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 964/1890] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:53 2022] DELETE /identity/v3/projects/eeff55abf253405994b438f4ccb308c1 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:53.497749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90784a2-fab1-419f-9e38-1f96c46b72db None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.498103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90784a2-fab1-419f-9e38-1f96c46b72db None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.498366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90784a2-fab1-419f-9e38-1f96c46b72db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.502284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:53.503149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.503534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.504111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.513249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.519273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e90784a2-fab1-419f-9e38-1f96c46b72db None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:53.527172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e90784a2-fab1-419f-9e38-1f96c46b72db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.591178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:53.592708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:53.605751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 927/1891] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:53.635073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 965/1892] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:53.644435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.646223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.659179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.659443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.659723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.670100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949a2f5-ef4e-428a-bbef-d81462be1d89 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:53.684462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:53.685332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.685673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.685942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] PATH_INFO: `/v3/projects/c861f34efa284d05b9f28fe6e2620894` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.687317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:53.688270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c861f34efa284d05b9f28fe6e2620894)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:53.688543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:53.694831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:53.704714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 966/1893] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:53.705730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.721672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92d487-7833-4b80-96e6-357020e6bb06 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:53.729743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:53.730496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.731197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.731197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.731933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:53.732259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:53.734574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:53.755584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 967/1894] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:53.756535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.767528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54fb39-4f85-422e-ae5b-3c23913ce934 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:53.772279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:53.773012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:53.773334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:53.774690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:53.774690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:53.777304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:53.892134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c861f34efa284d05b9f28fe6e2620894', 'request_id': 'req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.897049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:53.910462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 968/1895] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:53 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:53.911765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:53.920663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c861f34efa284d05b9f28fe6e2620894', 'request_id': 'req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:53.936472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c861f34efa284d05b9f28fe6e2620894', 'request_id': 'req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.049676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf800c1-d1cc-47ca-9233-66feb6fd6a78 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.055824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.056550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.056837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.057873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.058984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.061714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.062868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] The token cache is being invalidate because project c861f34efa284d05b9f28fe6e2620894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:54.063168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.067037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d0a1f90-1bce-49e5-b5ba-3d8f26aa24d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.068687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 928/1896] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:53 2022] DELETE /identity/v3/projects/c861f34efa284d05b9f28fe6e2620894 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:54.074899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf52b-82d5-4458-b7aa-ecff8c41b5d6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.075185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf52b-82d5-4458-b7aa-ecff8c41b5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.075461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baf52b-82d5-4458-b7aa-ecff8c41b5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.102092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-68baf52b-82d5-4458-b7aa-ecff8c41b5d6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:54.103489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-68baf52b-82d5-4458-b7aa-ecff8c41b5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.112296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 929/1897] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:54.122244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.122610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.122956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.142353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:54.143647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.153301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 930/1898] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:54.166118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.178636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72a931-cb8a-45ba-b853-f4a5b875e24b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.183809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.184614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.184898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.185173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.185938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:54.186241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.187840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.198296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 969/1899] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:53 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:54.205104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 931/1900] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:54.205442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.206267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.206420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.219549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e62786-ab9f-4d05-af86-4a435e1bd989 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.221991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f100d-0812-48ef-9c79-fb457f0e731c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.224192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.225093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.225441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.225760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.226794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.226932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.227473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.227759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.228033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.228553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.228743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.231008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.240076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 970/1901] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:54.244027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.256207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e132a-5eca-4004-b293-76ff96553e2a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.263104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.263776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.264059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.264329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.265053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.266671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.282205 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 971/1902] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:54.283863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.296928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39daa1-459f-496d-af3f-b1c6d812961b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.314876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.315739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.316094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.316552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] PATH_INFO: `/v3/projects/c708098facd145e988b6785a3e0f2cd2/users/ddce20634f434b4cb83809efe6367a4f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.339883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c708098facd145e988b6785a3e0f2cd2, user_id=ddce20634f434b4cb83809efe6367a4f, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.345222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.351333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 932/1903] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:54.352517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.354950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.422865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f5328-a355-45d0-851a-0cdc5dae45b8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.427955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.428878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.429153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.429517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] PATH_INFO: `/v3/projects/4b6cd4135370437ba2566aafd2f024ab` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.431648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b6cd4135370437ba2566aafd2f024ab)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.434654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.445211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 972/1904] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:54 2022] PUT /identity/v3/projects/c708098facd145e988b6785a3e0f2cd2/users/ddce20634f434b4cb83809efe6367a4f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:54.450850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.525532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948d618a-df7c-44c1-8d3d-f56f0643849f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.530441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.531147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.531433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.531715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.535705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.535705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536f50c-1994-43dd-9699-c803c74d2776 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.573752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b6cd4135370437ba2566aafd2f024ab', 'request_id': 'req-722333b7-612c-4e55-98ef-90ce7b2e357f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.580166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b6cd4135370437ba2566aafd2f024ab', 'request_id': 'req-722333b7-612c-4e55-98ef-90ce7b2e357f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.594394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b6cd4135370437ba2566aafd2f024ab', 'request_id': 'req-722333b7-612c-4e55-98ef-90ce7b2e357f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.668265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 973/1905] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:54.676553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.676553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.676553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.698209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] MFA Rules not processed for user `ddce20634f434b4cb83809efe6367a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:54.699646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.706138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] The token cache is being invalidate because project 4b6cd4135370437ba2566aafd2f024ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:54.706541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.707259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:54.709223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 933/1906] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:54 2022] DELETE /identity/v3/projects/4b6cd4135370437ba2566aafd2f024ab => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:54.713072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.715107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.774808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 974/1907] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:54.778199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.780772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.799063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722333b7-612c-4e55-98ef-90ce7b2e357f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.799926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcc4b1-f2c9-4104-a0aa-8ad87b5afa39 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.804258 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.804794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.804926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.805112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.805432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.805709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.805992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.806161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.808364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] PATH_INFO: `/v3/users/0467796b791a4f18b2f7f74694da24df` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.808364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0467796b791a4f18b2f7f74694da24df)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.808869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.810027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:54.819190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 934/1908] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:54.819994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:54.821701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:54.834169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3547de4-5dfb-4cf5-ad56-7501463390de admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:54.840112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:54.840945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:54.842807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:54.842807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:54.842807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:54.844204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.000441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 935/1909] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:54 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:55.000441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.076683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0467796b791a4f18b2f7f74694da24df'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:55.077421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0467796b791a4f18b2f7f74694da24df'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:55.089641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77860d54-9327-4242-ab41-e78736339550 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.090943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0467796b791a4f18b2f7f74694da24df'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:55.102338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.102338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.102338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.102338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.102759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.103934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.115912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 936/1910] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:55.116447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.130481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77428121-ffe1-423f-8e66-2c595d0c63bf admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.136324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.137054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.137465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.138017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.138590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.140379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.205022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0467796b791a4f18b2f7f74694da24df'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:55.205672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0467796b791a4f18b2f7f74694da24df'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:55.222225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 975/1911] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:54 2022] DELETE /identity/v3/users/0467796b791a4f18b2f7f74694da24df => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:55.223214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.224612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.240722 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 937/1912] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:55 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:55.247927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.252665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.269116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd56ab2-9000-44ea-b158-58e5b6435fb4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.334934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ae775-4ac1-484f-bbf9-47061507fa2f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.344727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.347781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.347781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.347781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] PATH_INFO: `/v3/projects/f18295dedbe24f03b8ee488c5d715738/users/81bf00abd73e40789dada1bc126b4504/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.361106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.361831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.362115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.362397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.362513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18295dedbe24f03b8ee488c5d715738, user_id=81bf00abd73e40789dada1bc126b4504, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.363124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.364819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.365383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661096d6-3798-4991-a2d7-af93d3269fc9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.380301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 938/1913] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:55.381314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.395083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d9074-001f-4b0c-b2d3-56e57d1530d4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.400645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.401776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.402063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.402346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] PATH_INFO: `/v3/projects/76d904ef204f40e8a16cba50ca093313/users/97c307d6460a40d988c7581ecd859a4d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.421109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d904ef204f40e8a16cba50ca093313, user_id=97c307d6460a40d988c7581ecd859a4d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.423846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.493980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 976/1914] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:55 2022] PUT /identity/v3/projects/f18295dedbe24f03b8ee488c5d715738/users/81bf00abd73e40789dada1bc126b4504/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:55.501441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.501732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.502011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.531142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] MFA Rules not processed for user `81bf00abd73e40789dada1bc126b4504`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:55.532701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.537292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 939/1915] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:55 2022] PUT /identity/v3/projects/76d904ef204f40e8a16cba50ca093313/users/97c307d6460a40d988c7581ecd859a4d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:55.545957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.621464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 977/1916] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:38:55.628808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.631432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.635273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564487e-a89f-44e0-8c0e-c3e7e6e8161f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.641174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.645749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.645749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.645749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.645749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.645749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.659686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 940/1917] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:55.661733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.678266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e012e6b-657a-4fb9-8ce2-c1680bd4c2e4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.686826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.690053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.690355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.690633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] PATH_INFO: `/v3/projects/76d904ef204f40e8a16cba50ca093313/users/97c307d6460a40d988c7581ecd859a4d/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.694127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d904ef204f40e8a16cba50ca093313, user_id=97c307d6460a40d988c7581ecd859a4d, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.702446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f87cd-e39b-44e8-861c-e93336a76dbe admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.716449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18738918-29cc-4691-b1db-e171981e0e43 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.729855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 941/1918] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:55 2022] PUT /identity/v3/projects/76d904ef204f40e8a16cba50ca093313/users/97c307d6460a40d988c7581ecd859a4d/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:55.731770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.732068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.732326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.764991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] MFA Rules not processed for user `97c307d6460a40d988c7581ecd859a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:55.766648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.782173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.782965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.783271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.783553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.855449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.857064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.869318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 942/1919] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:55.869318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.869318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.874719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 978/1920] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:55.878655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:55.880103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:55.903780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441163ff-150b-4a30-95c6-a6e62b6bc122 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.909354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.910677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.911085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.911378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.925945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.927695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221da0a9-e4e9-4dda-9507-2675a72a37ba service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:55.941801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 979/1921] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:55.973357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6721005c-51e4-4393-bfe5-1d302d163511 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:55.981044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:55.982513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:55.982947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:55.983367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] PATH_INFO: `/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:55.985065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8340bc6cdfd44d3bb3fad80ad6d1c68)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:55.988178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.178135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8340bc6cdfd44d3bb3fad80ad6d1c68', 'request_id': 'req-6251553e-d9bc-4411-aafb-88f6b1ab0fce'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:56.185225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8340bc6cdfd44d3bb3fad80ad6d1c68', 'request_id': 'req-6251553e-d9bc-4411-aafb-88f6b1ab0fce'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:56.190895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8340bc6cdfd44d3bb3fad80ad6d1c68', 'request_id': 'req-6251553e-d9bc-4411-aafb-88f6b1ab0fce'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:56.314019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] The token cache is being invalidate because project e8340bc6cdfd44d3bb3fad80ad6d1c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:38:56.314019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:56.314732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:38:56.316811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 943/1922] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:38:55 2022] DELETE /identity/v3/projects/e8340bc6cdfd44d3bb3fad80ad6d1c68 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:56.322606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57532-1bfa-47e8-8415-5a33b572928c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.323178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57532-1bfa-47e8-8415-5a33b572928c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.323717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce57532-1bfa-47e8-8415-5a33b572928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.343411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.348756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:56.353285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4ce57532-1bfa-47e8-8415-5a33b572928c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:56.353472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4ce57532-1bfa-47e8-8415-5a33b572928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:56.412747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251553e-d9bc-4411-aafb-88f6b1ab0fce admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:56.416787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:56.417497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.417768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.418043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.419959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:56.429777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 980/1923] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:56.439131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.440103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.440103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.462782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:56.467115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:56.476065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 981/1924] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:56.480703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.491315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059a99a-ab8f-4c4f-a3aa-dd52124536ab None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:56.497536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:56.498727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.499084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.499563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.500585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:38:56.500964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:56.503568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.504182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:56.506657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:56.508295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.520259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 982/1925] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:38:56.524821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.534977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 944/1926] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:38:56.542872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b6f41-f86b-4c7e-9ed8-a0726ac279a1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:56.548223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:56.548930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.549381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.549665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.550392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:56.552404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.665029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 983/1927] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:56 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:56.666151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.678386 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0503e0f-7dc0-4ffd-a80e-6b611d9aebb5 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:56.736157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:56.736844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.737130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.737446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.738176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:56.740091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.777195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:56.897155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 945/1928] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:56 2022] POST /identity/v3/users => generated 290 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:56.915585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.928744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b3f1a-fe5a-4671-bb7c-8056da89a13b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:56.942743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:56.944281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:56.945284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:56.957317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:56.957317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:56.957317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:56.973531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 984/1929] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:56.973701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:56.983841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fffeb3-014d-4eef-9b6d-f319ab0f9cf3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.000163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.000163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.000163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.000163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.000568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.000568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ab484-c138-46c0-a516-26eebe3174a3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.013758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 946/1930] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:57.016137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:57.030902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc4cdf-b461-4f64-888b-c62eb320ba68 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.038652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.039565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.039874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.040148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] PATH_INFO: `/v3/projects/01c8ecd1804b4d72a38c57dbe846021e/users/d3349c05205d46c48257a92c4e15aa71/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.058641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c8ecd1804b4d72a38c57dbe846021e, user_id=d3349c05205d46c48257a92c4e15aa71, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.061356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.171443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 985/1931] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:57 2022] PUT /identity/v3/projects/01c8ecd1804b4d72a38c57dbe846021e/users/d3349c05205d46c48257a92c4e15aa71/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:57.183278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.183650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.183933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.211213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] MFA Rules not processed for user `d3349c05205d46c48257a92c4e15aa71`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:57.212691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:57.284405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 947/1932] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:57.288850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:57.365576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5348d-79a3-4915-be99-6fa31178828f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.371095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.371761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.372053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.372330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.373045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.375057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.547067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 986/1933] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:38:57 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:38:57.551226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:57.563095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da452de-f273-43ad-8b82-044c8615ba67 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.622476 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.623146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.623468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.623755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.624441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.626497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.732723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 948/1934] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:38:57 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:38:57.736738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:57.750808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd242c3-27b7-4d2a-8911-43be605bf4ba admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.755522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.756192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.756482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.756764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.758262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.761583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.788010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 987/1935] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:38:57.789997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:57.801618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614cfcc-33ac-4a07-830b-cab4386b8732 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:57.806508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:57.808428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:57.808726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:57.809007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] PATH_INFO: `/v3/projects/198f38370f44482d93832ac57c2817e4/users/6aebe63e27984f94ba7193cf0d9baa23/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:57.825284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198f38370f44482d93832ac57c2817e4, user_id=6aebe63e27984f94ba7193cf0d9baa23, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:57.828161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:57.856758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:57.987575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 949/1936] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:57 2022] PUT /identity/v3/projects/198f38370f44482d93832ac57c2817e4/users/6aebe63e27984f94ba7193cf0d9baa23/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:57.988513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:58.000534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a417b7-3e80-41f4-938b-d22bb579572d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:58.099655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:58.100449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:58.100899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:58.101244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:58.102081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:58.106513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089df21-dfef-4392-857a-2c7713776688 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:58.114367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 988/1937] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:38:58.118529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:58.132912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0704-08bf-4ba6-9a2d-c545282cffd1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:58.143381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:58.144378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:58.144666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:58.144943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] PATH_INFO: `/v3/projects/198f38370f44482d93832ac57c2817e4/users/6aebe63e27984f94ba7193cf0d9baa23/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:58.147144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198f38370f44482d93832ac57c2817e4, user_id=6aebe63e27984f94ba7193cf0d9baa23, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:58.149904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:58.161151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 950/1938] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:38:58 2022] PUT /identity/v3/projects/198f38370f44482d93832ac57c2817e4/users/6aebe63e27984f94ba7193cf0d9baa23/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:38:58.171788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:58.172081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:58.172367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:58.205549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] MFA Rules not processed for user `6aebe63e27984f94ba7193cf0d9baa23`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:38:58.205549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:58.271878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 989/1939] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:38:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:38:58.791363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:58.793441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:38:58.852545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630038ba-b22d-44e9-be6c-9e93ad32bef9 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:38:58.857319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:38:58.858122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:38:58.858412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:38:58.858690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:38:58.969648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:38:58.971153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c42c13-08df-477f-9c71-ad3e48c019ff service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:38:58.983021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 951/1940] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:38:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:38:59.663137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:38:59.956778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:38:59.958817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:00.087280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d1c8-17b0-4076-ba36-c2847ee262f2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:00.100211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:00.101116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:00.101436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:00.101719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] PATH_INFO: `/v3/users/58b0d81482364cc698460205bb19d2db` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:00.102938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b0d81482364cc698460205bb19d2db)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:00.105289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:00.371835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b0d81482364cc698460205bb19d2db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:00.372481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b0d81482364cc698460205bb19d2db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:00.388437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b0d81482364cc698460205bb19d2db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:00.485971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b0d81482364cc698460205bb19d2db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:00.486779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b0d81482364cc698460205bb19d2db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:00.529660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 990/1941] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:38:59 2022] DELETE /identity/v3/users/58b0d81482364cc698460205bb19d2db => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:00.534594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:00.534594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:00.535215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:00.559502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:00.562471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:00.563607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:00.666111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 952/1942] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:00.676212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:00.677805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:00.768202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b6aba-da2b-4e35-8480-be4d1aeea11d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:00.772462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:00.773149 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:00.773464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:00.773743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:00.787903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:00.796735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:00.806274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 991/1943] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:01.012285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:01.015880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:01.076103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bb368-2a48-45f4-8520-fa74c19257ea None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:01.080152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:01.080810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:01.081092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:01.084165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:01.096727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:01.181193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:01.183405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:01.193342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 953/1944] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:01.381569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:01.387705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:01.421454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393ad79-2510-43ab-8ec1-5c349e16a222 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:01.439495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:01.440645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:01.442916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:01.442916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] PATH_INFO: `/v3/projects/b7c46aea94ad46ad88d8d927e26de536` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:01.442916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c46aea94ad46ad88d8d927e26de536)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:01.444499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:01.583645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c46aea94ad46ad88d8d927e26de536', 'request_id': 'req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:01.591749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c46aea94ad46ad88d8d927e26de536', 'request_id': 'req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:01.599773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c46aea94ad46ad88d8d927e26de536', 'request_id': 'req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:01.735863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] The token cache is being invalidate because project b7c46aea94ad46ad88d8d927e26de536 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:01.736472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:01.736711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:01.738657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 992/1945] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:01 2022] DELETE /identity/v3/projects/b7c46aea94ad46ad88d8d927e26de536 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:01.743975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:01.755835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc04aa-e6ae-4836-81dc-b0f4ed45c112 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:01.815018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:01.815903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:01.816190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:01.816468 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] PATH_INFO: `/v3/users/ec5979fc4ea9403faabfc1b988d03554` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:01.817699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec5979fc4ea9403faabfc1b988d03554)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:01.819681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:02.174299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec5979fc4ea9403faabfc1b988d03554'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:02.186976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec5979fc4ea9403faabfc1b988d03554'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:02.317473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec5979fc4ea9403faabfc1b988d03554'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:02.318131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec5979fc4ea9403faabfc1b988d03554'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:02.318770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec5979fc4ea9403faabfc1b988d03554'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:02.339422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 954/1946] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:01 2022] DELETE /identity/v3/users/ec5979fc4ea9403faabfc1b988d03554 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:02.889721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:02.891964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:02.906675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e33c0c-36e2-45d1-a36d-ab1cfdc0a933 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:02.977591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:02.978689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:02.978975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:02.979253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] PATH_INFO: `/v3/projects/5847cc8f5e70464a8148025e73725836` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:02.980834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5847cc8f5e70464a8148025e73725836)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:02.982801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:03.080438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:03.137097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5847cc8f5e70464a8148025e73725836', 'request_id': 'req-13de7b01-4539-4ba3-9eaa-096ab2998295'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.143577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5847cc8f5e70464a8148025e73725836', 'request_id': 'req-13de7b01-4539-4ba3-9eaa-096ab2998295'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.149479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5847cc8f5e70464a8148025e73725836', 'request_id': 'req-13de7b01-4539-4ba3-9eaa-096ab2998295'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.353390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] The token cache is being invalidate because project 5847cc8f5e70464a8148025e73725836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:03.353864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.354504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.356595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 993/1947] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:02 2022] DELETE /identity/v3/projects/5847cc8f5e70464a8148025e73725836 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:03.360744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:03.362605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:03.377356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd525c75-8392-4926-9eb2-8eef98e2b46e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:03.434253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:03.435048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:03.435334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:03.435612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] PATH_INFO: `/v3/users/2650b83d67694811951a514c4ee303eb` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:03.436800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2650b83d67694811951a514c4ee303eb)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:03.438750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:03.451573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:03.751380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2650b83d67694811951a514c4ee303eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.764200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2650b83d67694811951a514c4ee303eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.874557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2650b83d67694811951a514c4ee303eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.875540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2650b83d67694811951a514c4ee303eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.876512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6d3d363b-444f-4a47-aedc-820e9b13506e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2650b83d67694811951a514c4ee303eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:03.892715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 955/1948] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:03 2022] DELETE /identity/v3/users/2650b83d67694811951a514c4ee303eb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:04.528608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:04.530197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:04.543862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7b01-4539-4ba3-9eaa-096ab2998295 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:04.620637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:04.622088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:04.622469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:04.622987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] PATH_INFO: `/v3/projects/aa3764f64be84e10ae004f2f4abfc995` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:04.624403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3764f64be84e10ae004f2f4abfc995)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:04.630354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:04.748705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3764f64be84e10ae004f2f4abfc995', 'request_id': 'req-24eb4e34-80d2-4d40-be17-bda1216a7759'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:04.756017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3764f64be84e10ae004f2f4abfc995', 'request_id': 'req-24eb4e34-80d2-4d40-be17-bda1216a7759'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:04.761608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3764f64be84e10ae004f2f4abfc995', 'request_id': 'req-24eb4e34-80d2-4d40-be17-bda1216a7759'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:04.888169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] The token cache is being invalidate because project aa3764f64be84e10ae004f2f4abfc995 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:04.888462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:04.889121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-24eb4e34-80d2-4d40-be17-bda1216a7759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:04.890753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 994/1949] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:04 2022] DELETE /identity/v3/projects/aa3764f64be84e10ae004f2f4abfc995 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:04.896874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:04.897363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:04.897465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:04.915692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:04.916923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:04.980067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 956/1950] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:04.990294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:04.990590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:04.990875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.010051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:05.011262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:05.019471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 995/1951] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:05.023808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.033950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ee44-e7bf-46ef-9e0d-601349399d80 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.038904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.039571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.039855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.040162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.040853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:05.041161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.042849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.055610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 957/1952] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:05.060746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.070787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e61865-5b0d-4997-b1be-6481cb5ccecb None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.075669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.076338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.076621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.076897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.077677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.079724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.240004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 996/1953] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:05 2022] POST /identity/v3/projects => generated 409 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:05.249058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.260694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b76429-5ea2-4860-8a4c-997e8b8fb3cd admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.334308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.335318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.335812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.336261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.337719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.339966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.460483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 958/1954] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:05 2022] POST /identity/v3/users => generated 305 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:05.461529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.472975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4402-441a-49cd-8b97-1a2de4753649 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.478459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.479347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.479635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.479915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.480637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.482324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.493130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 997/1955] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:05.497983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.508692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e97fb1-e502-4bed-a20f-967a3abb0bf5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.514094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.514884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.515167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.515444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.516172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.517801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bfa49c-e0b7-47c1-98e6-bfa60fa16220 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.533975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 959/1956] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:05.538385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.548883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d442c0-c015-40fd-b5be-d14541cedbe4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.553610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.554508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.554768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.555854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] PATH_INFO: `/v3/projects/8af963b15ee243a9b2fa546b76eae1b1/users/06292aa2eedb4b1387e12909765957fc/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.570239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8af963b15ee243a9b2fa546b76eae1b1, user_id=06292aa2eedb4b1387e12909765957fc, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.572845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:05.609471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:05.715348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 998/1957] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:05 2022] PUT /identity/v3/projects/8af963b15ee243a9b2fa546b76eae1b1/users/06292aa2eedb4b1387e12909765957fc/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:05.730406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201014-99e1-46b7-a9ec-42b08fc0a6c2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.730702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201014-99e1-46b7-a9ec-42b08fc0a6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.730986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48201014-99e1-46b7-a9ec-42b08fc0a6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.775560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-48201014-99e1-46b7-a9ec-42b08fc0a6c2 None None] MFA Rules not processed for user `06292aa2eedb4b1387e12909765957fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:05.780414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-48201014-99e1-46b7-a9ec-42b08fc0a6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:05.860624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 960/1958] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:05 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:05.862140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:05.932420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a22b8a-930f-4eb3-867f-9d03157ae6bc admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:05.937706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:05.938402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:05.938712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:05.938996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:05.939742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:05.941809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e93-057e-4ba1-a816-2b5263b360c1 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e93-057e-4ba1-a816-2b5263b360c1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4979e93-057e-4ba1-a816-2b5263b360c1 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 961/1959] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:39:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.087641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.088495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.088495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] MFA Rules not processed for user `f25676e7b2c74e65b86b758cfdccf216`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:06.090663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:06.162098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 962/1960] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:39:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:06.178310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:06.179694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:06.193444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbba6fa-5ca8-467a-99c5-c1ea7ac78b12 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:06.328556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:06.328556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.328556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.328556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.329895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:06.329895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.329895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 963/1961] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:06.482950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 999/1962] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:05 2022] POST /identity/v3/projects => generated 409 bytes in 621 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:06.489250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:06.501365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:06.506377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:06.513795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa2a3-6961-4c48-8797-df59db999dfa service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:06.614506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:06.615382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.615869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.616284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.617312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:06.621311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.629851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03219a2-f06e-4939-8ae9-60a417a1ca1d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:06.635140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:06.636100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.636468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.636937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] PATH_INFO: `/v3/users/2524a1e26aa74ba896771209dca9fbec` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.638877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2524a1e26aa74ba896771209dca9fbec)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:06.641198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.770185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 964/1963] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:06 2022] POST /identity/v3/users => generated 311 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:06.771076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:06.781828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4629b76-f367-423a-9013-54901bf69327 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:06.786716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:06.787391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.787679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.787958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.788688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:06.790316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.805148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 965/1964] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:06.806266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:06.816026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7079f0-54ba-4f6d-ad3c-04653ae55f9f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:06.827185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:06.827185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:06.827185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:06.827185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] PATH_INFO: `/v3/projects/88b1cd5539884753bb3383fd19b38a0f/users/46015226b9e04fba8725a5f6797d112e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:06.838343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b1cd5539884753bb3383fd19b38a0f, user_id=46015226b9e04fba8725a5f6797d112e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:06.841549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:06.920973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2524a1e26aa74ba896771209dca9fbec'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:06.921650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2524a1e26aa74ba896771209dca9fbec'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:06.933589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2524a1e26aa74ba896771209dca9fbec'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:06.959818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 966/1965] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:06 2022] PUT /identity/v3/projects/88b1cd5539884753bb3383fd19b38a0f/users/46015226b9e04fba8725a5f6797d112e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:06.970516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:07.025187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760ba8d-7777-41e7-9da2-6d72af0729a5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:07.030617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:07.031432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:07.031754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:07.032106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:07.033005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:07.034693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:07.045219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 967/1966] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:07.049084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:07.058598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb5f27-9e4e-4117-8ff7-9d00afb8675a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:07.073597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:07.073597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:07.073597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:07.073597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] PATH_INFO: `/v3/projects/88b1cd5539884753bb3383fd19b38a0f/users/46015226b9e04fba8725a5f6797d112e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:07.073975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b1cd5539884753bb3383fd19b38a0f, user_id=46015226b9e04fba8725a5f6797d112e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:07.073975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53a7ef1-447b-41e2-b10f-b85001a3b3f0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:07.081444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 968/1967] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:07 2022] PUT /identity/v3/projects/88b1cd5539884753bb3383fd19b38a0f/users/46015226b9e04fba8725a5f6797d112e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:07.092632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:07.093236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:07.093236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:07.124811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] MFA Rules not processed for user `46015226b9e04fba8725a5f6797d112e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:07.126072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:07.159435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2524a1e26aa74ba896771209dca9fbec'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:07.165377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2524a1e26aa74ba896771209dca9fbec'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:07.173853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1000/1968] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:06 2022] DELETE /identity/v3/users/2524a1e26aa74ba896771209dca9fbec => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:07.198292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 969/1969] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:07.210007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:07.211465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:07.274328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed4b79-8c65-4280-825a-d6281dd1a896 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:07.278054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:07.279358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:07.279634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:07.279904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:07.351336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:07.352774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:07.364123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1001/1970] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:07.766818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:07.768668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:07.828801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:07.889401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dadc3a1-8de6-4f98-abbf-2fa359555976 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:07.901570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:07.908753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.006864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.007854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.008268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.008627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] PATH_INFO: `/v3/projects/3268641ef3164a9e934c362142f80fb4` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.009969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3268641ef3164a9e934c362142f80fb4)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.011982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.033605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8073c-205d-4b79-8a21-76ce48100f56 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:08.038661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.039655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.039940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.040225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] PATH_INFO: `/v3/users/d3349c05205d46c48257a92c4e15aa71` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.041640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3349c05205d46c48257a92c4e15aa71)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.043732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.415471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3268641ef3164a9e934c362142f80fb4', 'request_id': 'req-570646e9-974f-407f-8cac-d8d391cf16e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.422643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3268641ef3164a9e934c362142f80fb4', 'request_id': 'req-570646e9-974f-407f-8cac-d8d391cf16e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.425027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3349c05205d46c48257a92c4e15aa71'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.425713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3349c05205d46c48257a92c4e15aa71'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.428299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3268641ef3164a9e934c362142f80fb4', 'request_id': 'req-570646e9-974f-407f-8cac-d8d391cf16e1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.438064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3349c05205d46c48257a92c4e15aa71'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.598606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] The token cache is being invalidate because project 3268641ef3164a9e934c362142f80fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:08.598895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.599541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.604596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 970/1971] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:07 2022] DELETE /identity/v3/projects/3268641ef3164a9e934c362142f80fb4 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:08.604596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:08.604596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.651388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3349c05205d46c48257a92c4e15aa71'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.652243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1af80ee7-2f43-4929-ad14-b01e0fa85d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3349c05205d46c48257a92c4e15aa71'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:08.662417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570646e9-974f-407f-8cac-d8d391cf16e1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:08.666225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1002/1972] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:07 2022] DELETE /identity/v3/users/d3349c05205d46c48257a92c4e15aa71 => generated 0 bytes in 765 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:08.666343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.666932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.667223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.667438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01010-e568-436b-8477-9ba110360df8 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.667525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.667733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01010-e568-436b-8477-9ba110360df8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.668099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf01010-e568-436b-8477-9ba110360df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.669674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.689887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-6cf01010-e568-436b-8477-9ba110360df8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:08.691097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6cf01010-e568-436b-8477-9ba110360df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.729460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.730912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c05d7-65f1-44f3-8a21-09a27f9fc620 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.740041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 971/1973] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:08.741394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.741698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.741960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.752944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1003/1974] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:08.771002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.771002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.771002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.771230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:08.771230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.783057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 972/1975] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:08.787465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:08.788709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.791014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:08.806246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:08.806480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1004/1976] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:08.812680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:08.823808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121e251-27ab-4a71-8965-4b062ddada0d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:08.832163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.832163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.832163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.832163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.835347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:08.835347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.835347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.849773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1005/1977] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:39:08.854358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:08.869814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac260f9-24cb-4241-8486-f11e473b986c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:08.869984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5097d1e-4415-4b6f-833f-ad96eb7c86f8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:08.873212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.874000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.874279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.874558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.877909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:08.879501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:08.879790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:08.880071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:08.881898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.884627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.885907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:08.888578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:08.900778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 973/1978] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:09.143819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1006/1979] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:08 2022] POST /identity/v3/projects => generated 383 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:09.147978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.162277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38dc077-f0f4-45b6-b76f-631582cb118e service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.218096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.218778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.219063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.219341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.220087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.222083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.349782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 974/1980] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:09 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:09.353911 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.365619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05075c1c-b5d9-4241-ab17-ccc31055066f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.370362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.371020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.371302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.371606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.373506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.375235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.385773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1007/1981] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:09.389875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.404407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8c3ab-8fba-4b81-9e59-ef2b19ce2808 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.405986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.406671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.406951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.407226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.408092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.409755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.421033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 975/1982] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:09.425367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.435854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a0a8e-b9e9-4a9d-8947-b535f254251c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.440331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.441200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.441518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.441796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] PATH_INFO: `/v3/projects/0afc2f91394c411fafe093cc678dc12c/users/fbf34d02af8b45c3a6b8e7f20e555f09/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.456617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afc2f91394c411fafe093cc678dc12c, user_id=fbf34d02af8b45c3a6b8e7f20e555f09, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.459452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15929a69-0e4f-4633-a4be-c153819aca36 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.473078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.475042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.489891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21916883-b94e-4baa-9f48-e1300afab65d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.495247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.496149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.496467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.496798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] PATH_INFO: `/v3/projects/01c8ecd1804b4d72a38c57dbe846021e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.509862 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c8ecd1804b4d72a38c57dbe846021e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.511833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.578629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1008/1983] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:09 2022] PUT /identity/v3/projects/0afc2f91394c411fafe093cc678dc12c/users/fbf34d02af8b45c3a6b8e7f20e555f09/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:09.580740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.581033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.581425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.612240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] MFA Rules not processed for user `fbf34d02af8b45c3a6b8e7f20e555f09`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:09.613579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.669105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c8ecd1804b4d72a38c57dbe846021e', 'request_id': 'req-b0842d17-45ad-45a4-82da-aaad57f08cf6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:09.675727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c8ecd1804b4d72a38c57dbe846021e', 'request_id': 'req-b0842d17-45ad-45a4-82da-aaad57f08cf6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:09.681422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1009/1984] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:09.687217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c8ecd1804b4d72a38c57dbe846021e', 'request_id': 'req-b0842d17-45ad-45a4-82da-aaad57f08cf6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:09.701395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.710049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.772630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:09.777501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] The token cache is being invalidate because project 01c8ecd1804b4d72a38c57dbe846021e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:09.777855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:09.779645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:09.780747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 976/1985] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:09 2022] DELETE /identity/v3/projects/01c8ecd1804b4d72a38c57dbe846021e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:09.781665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.782971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.788455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f02dc-f395-4a0b-ad89-671a0a7eb3da None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.849392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0842d17-45ad-45a4-82da-aaad57f08cf6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.858961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.860155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.860578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.860885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] PATH_INFO: `/v3/users/ddce20634f434b4cb83809efe6367a4f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.862346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddce20634f434b4cb83809efe6367a4f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.863876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.864606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.864703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.864962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.865342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.867330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.939355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.940990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:09.950356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1010/1986] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:09.951693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:09.953126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:09.967777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6959f-0e8a-462b-8197-d6b7ea700dc6 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:09.973897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:09.974823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:09.975110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:09.975391 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] PATH_INFO: `/v3/users/6aebe63e27984f94ba7193cf0d9baa23` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:09.978039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aebe63e27984f94ba7193cf0d9baa23)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:09.980158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:10.009411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:10.193178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddce20634f434b4cb83809efe6367a4f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.205679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddce20634f434b4cb83809efe6367a4f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.230672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aebe63e27984f94ba7193cf0d9baa23'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.231910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aebe63e27984f94ba7193cf0d9baa23'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.244992 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aebe63e27984f94ba7193cf0d9baa23'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.306345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddce20634f434b4cb83809efe6367a4f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.306980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddce20634f434b4cb83809efe6367a4f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.308313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-48dff03d-dc58-410a-a6ce-705ac6900e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddce20634f434b4cb83809efe6367a4f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.326906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 977/1987] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:09 2022] DELETE /identity/v3/users/ddce20634f434b4cb83809efe6367a4f => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:10.331253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:10.331618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:10.332007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:10.353101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:10.354453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:10.364803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aebe63e27984f94ba7193cf0d9baa23'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.365449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aebe63e27984f94ba7193cf0d9baa23'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:10.379902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1011/1988] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:09 2022] DELETE /identity/v3/users/6aebe63e27984f94ba7193cf0d9baa23 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:10.415356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 978/1989] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:10.426141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:10.427760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:10.492596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67244b73-02cc-4c30-951f-19a6c063db9a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:10.496516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:10.497803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:10.498097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:10.498352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:10.564828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:10.566313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:10.577061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1012/1990] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:10.934906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:10.938710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:10.958783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357ac0-803f-42ea-89b8-bad92bc187cd None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:10.968423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:10.969615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:10.974763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:10.974763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] PATH_INFO: `/v3/projects/198f38370f44482d93832ac57c2817e4` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:10.974763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=198f38370f44482d93832ac57c2817e4)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:10.976513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.140592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198f38370f44482d93832ac57c2817e4', 'request_id': 'req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.146847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198f38370f44482d93832ac57c2817e4', 'request_id': 'req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.152541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198f38370f44482d93832ac57c2817e4', 'request_id': 'req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.212393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.213837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:11.227229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6945cd-aa5f-4104-81c5-758b77cbf036 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.291698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.292640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.293366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.293797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] PATH_INFO: `/v3/projects/c708098facd145e988b6785a3e0f2cd2` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.295651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c708098facd145e988b6785a3e0f2cd2)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.297720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.301232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] The token cache is being invalidate because project 198f38370f44482d93832ac57c2817e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:11.301558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.307969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0dc988a0-3dc8-4f52-a7d3-b96f4e8bc39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.307969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 979/1991] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:10 2022] DELETE /identity/v3/projects/198f38370f44482d93832ac57c2817e4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:11.308808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7d5c-154f-4c3f-9d83-d62bae1d77fc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.309166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7d5c-154f-4c3f-9d83-d62bae1d77fc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.310135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c7d5c-154f-4c3f-9d83-d62bae1d77fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.331494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-802c7d5c-154f-4c3f-9d83-d62bae1d77fc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:11.332693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-802c7d5c-154f-4c3f-9d83-d62bae1d77fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:11.340878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 980/1992] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:11.348612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.348896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.349171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.368209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:11.369475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:11.379201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 981/1993] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:11.383729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.394099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950db80-e072-41c6-a270-f1b2b8285d3e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.399187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.401334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.401334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.401334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.401641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:11.402152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.403892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.416979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 982/1994] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:39:11.421973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.432788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a24993-d246-49e3-a253-60c39c0b23c6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.438694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.439350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.439637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.439911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.440599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.442573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.471985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c708098facd145e988b6785a3e0f2cd2', 'request_id': 'req-4bee09de-b7e1-4af0-beb2-da94ea612196'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.478644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c708098facd145e988b6785a3e0f2cd2', 'request_id': 'req-4bee09de-b7e1-4af0-beb2-da94ea612196'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.485716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c708098facd145e988b6785a3e0f2cd2', 'request_id': 'req-4bee09de-b7e1-4af0-beb2-da94ea612196'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.552100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 983/1995] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:11 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:11.556124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.598955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] The token cache is being invalidate because project c708098facd145e988b6785a3e0f2cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:11.599248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.599870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.601469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1013/1996] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:11 2022] DELETE /identity/v3/projects/c708098facd145e988b6785a3e0f2cd2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:11.605509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.607805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:11.618608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9a2c7-54fa-43fe-aa1d-621ac2bd8bea admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.624155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.624836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.625130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.625533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.629192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.629192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.674185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee09de-b7e1-4af0-beb2-da94ea612196 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.678822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.679697 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.679978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.680256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] PATH_INFO: `/v3/users/97c307d6460a40d988c7581ecd859a4d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.681477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c307d6460a40d988c7581ecd859a4d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.683441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.777565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 984/1997] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:11 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:11.782168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.783793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:11.796378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d51039-5fba-4d9b-a752-2e6c602c1a17 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.800993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.801839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.802087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.802363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.803120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.804805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.816184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 985/1998] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:11.821370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.831412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d2487-2534-4aa8-ad82-9fd785cd6e04 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.835982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.836616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.837146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.837457 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.838212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.839858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.850834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 986/1999] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:11.861913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:11.871412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282b89e-f8dd-4358-9dae-781c2ea66075 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:11.876333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:11.877183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:11.877542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:11.877866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] PATH_INFO: `/v3/projects/c519a76b7c6c401cb2bdc45e6d0b7a29/users/4f6673632f37472aab7331f5f625f9e2/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:11.892945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c519a76b7c6c401cb2bdc45e6d0b7a29, user_id=4f6673632f37472aab7331f5f625f9e2, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:11.895856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d435ca5-a9f3-42c9-be09-15eb8b892870 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:11.933558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c307d6460a40d988c7581ecd859a4d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.934264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c307d6460a40d988c7581ecd859a4d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:11.946506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c307d6460a40d988c7581ecd859a4d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.016563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c307d6460a40d988c7581ecd859a4d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.017944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c307d6460a40d988c7581ecd859a4d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.023176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 987/2000] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:11 2022] PUT /identity/v3/projects/c519a76b7c6c401cb2bdc45e6d0b7a29/users/4f6673632f37472aab7331f5f625f9e2/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:12.034375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.034771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.035213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1014/2001] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:11 2022] DELETE /identity/v3/users/97c307d6460a40d988c7581ecd859a4d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:12.035342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.063227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] MFA Rules not processed for user `4f6673632f37472aab7331f5f625f9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:12.064528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:12.140719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 988/2002] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:12.142049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.143496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:12.213125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f640ee1-4c30-4ec2-b664-1d4b88889ecb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.218259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.219068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.219360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.219634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.220812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.222398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.266227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:12.344635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1015/2003] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:12 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:12.353711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.369479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe4454-9146-4736-a783-53e5e2f92952 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.442486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.443287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.443574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.443847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.444545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.446486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.549844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.553472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:12.570789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 989/2004] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:12 2022] POST /identity/v3/users => generated 301 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:12.573124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.579986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d057582-86e9-4b13-b66b-ceaa970b2dbb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.595629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011faf8f-ea65-4221-bfbc-2827b68eacc4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.597818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.598694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.598975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.599446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] PATH_INFO: `/v3/projects/76d904ef204f40e8a16cba50ca093313` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.601438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d904ef204f40e8a16cba50ca093313)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.603517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.608884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.609608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.609906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.610168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.610906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.612519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.632086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 990/2005] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:12.636070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.648173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b566d4d-e444-4044-8957-450e69fba193 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.654753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.655729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.656017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.656300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] PATH_INFO: `/v3/projects/7e6d9fb5b01e43e69d78883d58771dec/users/2bcfb4f1703d492f8b1f67fedb1410b9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.672965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6d9fb5b01e43e69d78883d58771dec, user_id=2bcfb4f1703d492f8b1f67fedb1410b9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.677761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.825999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 991/2006] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:12 2022] PUT /identity/v3/projects/7e6d9fb5b01e43e69d78883d58771dec/users/2bcfb4f1703d492f8b1f67fedb1410b9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:12.828845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.841772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d904ef204f40e8a16cba50ca093313', 'request_id': 'req-49c91b49-07b7-44a2-ba74-1b4a0e88deed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.863295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d904ef204f40e8a16cba50ca093313', 'request_id': 'req-49c91b49-07b7-44a2-ba74-1b4a0e88deed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.863295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d904ef204f40e8a16cba50ca093313', 'request_id': 'req-49c91b49-07b7-44a2-ba74-1b4a0e88deed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.897854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb89ba5-40a1-4bc1-be1a-eb03ada1e5e8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.955114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.955898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.956256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.956606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.957435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:12.959225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:12.969942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 992/2007] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:12.974379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:12.987576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16721a67-ab07-4a55-87dc-dae45e1b3252 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:12.998022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] The token cache is being invalidate because project 76d904ef204f40e8a16cba50ca093313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:12.998022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.998022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-49c91b49-07b7-44a2-ba74-1b4a0e88deed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:12.998252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:12.998252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:12.998252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:12.998252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] PATH_INFO: `/v3/projects/7e6d9fb5b01e43e69d78883d58771dec/users/2bcfb4f1703d492f8b1f67fedb1410b9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:12.998508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1016/2008] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:12 2022] DELETE /identity/v3/projects/76d904ef204f40e8a16cba50ca093313 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:13.003503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c222-a2c3-4a3e-b3d2-419658990845 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.003872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c222-a2c3-4a3e-b3d2-419658990845 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.004173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137c222-a2c3-4a3e-b3d2-419658990845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.005543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6d9fb5b01e43e69d78883d58771dec, user_id=2bcfb4f1703d492f8b1f67fedb1410b9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.008568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cc820-3073-4d70-bd5b-972db5ddfac2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.029890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 993/2009] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:12 2022] PUT /identity/v3/projects/7e6d9fb5b01e43e69d78883d58771dec/users/2bcfb4f1703d492f8b1f67fedb1410b9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:13.030557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b137c222-a2c3-4a3e-b3d2-419658990845 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:13.030557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b137c222-a2c3-4a3e-b3d2-419658990845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.033893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.034171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.034579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.064176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] MFA Rules not processed for user `2bcfb4f1703d492f8b1f67fedb1410b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:13.065492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.088424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1017/2010] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:13.096997 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.097318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.097654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.116871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:13.118293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.127430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1018/2011] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:13.131536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.141129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23082c53-d7bc-4c3d-aef8-a35a49cd0305 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.146114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.147016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.147493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.147659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 994/2012] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:13.149300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.149300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:13.149599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.151543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.165385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1019/2013] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:39:13.170201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.180440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6eba1-9e2b-4cf1-8400-7a08e1babdc2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.185507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.186163 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.186452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.186729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.187430 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.189353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.371428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:13.379327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 995/2014] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:13.384196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.384354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.385869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.394977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec444c27-8497-415c-84f3-efdcfa240610 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.447359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611b775-cbc8-4230-b5bc-fcfc747c3815 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.452033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.452830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.453175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.453545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.461553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.462497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.462772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.463044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.463745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.466422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.536485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.538242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.549799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 996/2015] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:13.595650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1020/2016] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:13.601110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.613201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c3259-b4dc-4f41-9787-a9be42ba05a3 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.622799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.623646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.623932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.624268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.625038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.626677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.643006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 997/2017] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:13.644266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.654695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb5ba4-3f92-41a0-85cd-2e0599367599 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.659990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.660856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.661147 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.661470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.662199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.663821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a80b7-4202-4da8-80db-872b79fe957f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.674069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1021/2018] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:13.678497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.689037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909ef00-7d01-48d2-83be-a55a337160ac admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.693709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.694625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.694913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.695196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] PATH_INFO: `/v3/projects/07ca08df59d14130af9f5928c36aca35/users/9321b0c6de844f229dc0b3be3b5cfc36/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.711891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07ca08df59d14130af9f5928c36aca35, user_id=9321b0c6de844f229dc0b3be3b5cfc36, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.714865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.810696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 998/2019] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:13 2022] PUT /identity/v3/projects/07ca08df59d14130af9f5928c36aca35/users/9321b0c6de844f229dc0b3be3b5cfc36/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:13.820912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.821497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.821805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.858101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.858354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] MFA Rules not processed for user `9321b0c6de844f229dc0b3be3b5cfc36`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:13.859665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.859857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:13.969711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1022/2020] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:13.970631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:13.978919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86346bc7-0481-417d-b1ef-5969e1b1c462 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.984266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.985217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.985781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:13.986049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] PATH_INFO: `/v3/users/4f6673632f37472aab7331f5f625f9e2` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:13.987272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f6673632f37472aab7331f5f625f9e2)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:13.990802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828de0c-bef4-471a-b53e-75aed6d71dbd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:13.991502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:13.998480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:13.999539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:13.999953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.000567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.002424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.005118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.149630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1023/2021] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:13 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:14.150671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.214505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f13b4-f367-4ed6-84da-8dc699bdff7a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.221096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.221844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.222129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.222459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.223143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.225193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.275537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f6673632f37472aab7331f5f625f9e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.288196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f6673632f37472aab7331f5f625f9e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.320809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1024/2022] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:14 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:14.324576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.334727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498993a-fb77-4b49-95ef-0218e56a8e56 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.339800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.340975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.341312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.341574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.342356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.344020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.354176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1025/2023] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:14.354958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.357230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.364982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f6673632f37472aab7331f5f625f9e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.365934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f6673632f37472aab7331f5f625f9e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.366551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f6673632f37472aab7331f5f625f9e2'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.370707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f247-8554-4576-bb35-fd2f502b5a0d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.374609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.375508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.375796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.376080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] PATH_INFO: `/v3/users/a6fbefed05014e6b915a6630b5b38eed` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.377475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6fbefed05014e6b915a6630b5b38eed)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.379429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.380779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 999/2024] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:13 2022] DELETE /identity/v3/users/4f6673632f37472aab7331f5f625f9e2 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:14.381555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.382898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.447915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967918fd-1952-4e9f-8817-83f02a9f277c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.452598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.453542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.453825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.456871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] PATH_INFO: `/v3/projects/e216dbb7021c446ebdcbb127c5e34017/users/bee14ba863874276a8e67b78ec2eac6e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.469331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216dbb7021c446ebdcbb127c5e34017, user_id=bee14ba863874276a8e67b78ec2eac6e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.472176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c903dd7-b8e8-4924-809a-75bdc014059a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.567699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6fbefed05014e6b915a6630b5b38eed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.568553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6fbefed05014e6b915a6630b5b38eed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.579939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:14.584470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6fbefed05014e6b915a6630b5b38eed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.590171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1000/2025] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:14 2022] PUT /identity/v3/projects/e216dbb7021c446ebdcbb127c5e34017/users/bee14ba863874276a8e67b78ec2eac6e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:14.590171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.590171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.590171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.610602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:14.611845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.674162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1001/2026] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:14.675130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.684373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f127d98-da67-4634-8f25-9ce10c01dc25 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.689317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.690040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.690269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.690545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.691268 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.693072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.696207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6fbefed05014e6b915a6630b5b38eed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.700639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6fbefed05014e6b915a6630b5b38eed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:14.704069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1002/2027] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:14.704724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.706513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.711898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1026/2028] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:14 2022] DELETE /identity/v3/users/a6fbefed05014e6b915a6630b5b38eed => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:14.713142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:14.714770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.767239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee260bd-2921-445d-a6ee-53fc82a3101f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.782901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21bb5d9-4826-4d54-ab07-b83ef34bf4c4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:14.788079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.788969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.789278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.789567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] PATH_INFO: `/v3/projects/e216dbb7021c446ebdcbb127c5e34017/users/bee14ba863874276a8e67b78ec2eac6e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.791573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e216dbb7021c446ebdcbb127c5e34017, user_id=bee14ba863874276a8e67b78ec2eac6e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.794922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b22e016-cbe0-43ee-b4cf-52a45def3e33 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.805386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1027/2029] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:14 2022] PUT /identity/v3/projects/e216dbb7021c446ebdcbb127c5e34017/users/bee14ba863874276a8e67b78ec2eac6e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:14.806720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.807207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.807429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.822908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:14.823570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.823851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.825364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.826927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.837802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:14.839232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.839503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:14.841543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc427de-c1b2-4020-9ec5-c40851232c59 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:14.852073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1003/2030] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:14.853324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:14.853766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:14.854031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:14.899377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] MFA Rules not processed for user `bee14ba863874276a8e67b78ec2eac6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:14.900743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:14.924648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1028/2031] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:14.936061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:15.005487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1004/2032] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:15.017927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:15.022992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:15.023782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2274ac-f115-403a-ba5a-5dcbb5e36ced None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:15.029398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:15.030083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:15.030373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:15.030741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:15.045219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:15.047227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:15.070503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1029/2033] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:15.096384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec404e4-7310-483e-8113-f4ede0e220a0 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:15.100636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:15.101449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:15.101803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:15.102156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:15.115682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:15.117324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:15.141021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1005/2034] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:15.216931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:15.398747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:15.430823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:15.433812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:15.451128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472b350-3da4-4fc2-98fc-b115f90936a7 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:15.457892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:15.459379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:15.459734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:15.461648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] PATH_INFO: `/v3/projects/c519a76b7c6c401cb2bdc45e6d0b7a29` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:15.461648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c519a76b7c6c401cb2bdc45e6d0b7a29)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:15.464629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:15.627902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c519a76b7c6c401cb2bdc45e6d0b7a29', 'request_id': 'req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.634365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c519a76b7c6c401cb2bdc45e6d0b7a29', 'request_id': 'req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.640577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c519a76b7c6c401cb2bdc45e6d0b7a29', 'request_id': 'req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.732795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:15.741774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:15.751897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715e027-02e3-47d7-8ee5-6071f41c95ee service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:15.769042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] The token cache is being invalidate because project c519a76b7c6c401cb2bdc45e6d0b7a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:15.769467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.770192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.771818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1030/2035] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:15 2022] DELETE /identity/v3/projects/c519a76b7c6c401cb2bdc45e6d0b7a29 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:15.775607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:15.776945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:15.812926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:15.813872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:15.814248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:15.814521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] PATH_INFO: `/v3/projects/865e3525754b4fc18f6e26c011be7f43` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:15.815808 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=865e3525754b4fc18f6e26c011be7f43)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:15.818017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:15.846735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e16d1a-29b4-433e-83d4-56dd8ba88c4c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:15.851566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:15.852430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:15.852708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:15.852979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] PATH_INFO: `/v3/users/2bcfb4f1703d492f8b1f67fedb1410b9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:15.854195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bcfb4f1703d492f8b1f67fedb1410b9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:15.856227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:15.960570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865e3525754b4fc18f6e26c011be7f43', 'request_id': 'req-000d7dbf-6600-49ba-9c67-09ac6ae008bb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.966985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865e3525754b4fc18f6e26c011be7f43', 'request_id': 'req-000d7dbf-6600-49ba-9c67-09ac6ae008bb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:15.972961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865e3525754b4fc18f6e26c011be7f43', 'request_id': 'req-000d7dbf-6600-49ba-9c67-09ac6ae008bb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.151310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] The token cache is being invalidate because project 865e3525754b4fc18f6e26c011be7f43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:16.151665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.152288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.154212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1006/2036] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:15 2022] DELETE /identity/v3/projects/865e3525754b4fc18f6e26c011be7f43 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:16.156971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:16.156971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.223124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d7dbf-6600-49ba-9c67-09ac6ae008bb admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:16.227844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bcfb4f1703d492f8b1f67fedb1410b9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.228619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bcfb4f1703d492f8b1f67fedb1410b9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.232422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:16.233504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.233739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.234052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] PATH_INFO: `/v3/users/81bf00abd73e40789dada1bc126b4504` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.235807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bf00abd73e40789dada1bc126b4504)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:16.237804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:16.241715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bcfb4f1703d492f8b1f67fedb1410b9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.335963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bcfb4f1703d492f8b1f67fedb1410b9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.336713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bcfb4f1703d492f8b1f67fedb1410b9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.350625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1031/2037] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:15 2022] DELETE /identity/v3/users/2bcfb4f1703d492f8b1f67fedb1410b9 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:16.353769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:16.353769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.433074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd6a1b-51fe-4887-8c74-f15daa5119a8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:16.439107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:16.440077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.440558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.440837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] PATH_INFO: `/v3/users/95d6185f85b34c2f997d4cbb528f8acc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.442096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d6185f85b34c2f997d4cbb528f8acc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:16.444068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:16.470678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bf00abd73e40789dada1bc126b4504'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.484891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bf00abd73e40789dada1bc126b4504'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.601771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bf00abd73e40789dada1bc126b4504'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.603225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bf00abd73e40789dada1bc126b4504'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.603953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bf00abd73e40789dada1bc126b4504'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.631080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1007/2038] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:16 2022] DELETE /identity/v3/users/81bf00abd73e40789dada1bc126b4504 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:16.632160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:16.634376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.708316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67ab06-61f8-4080-9bf5-19b4ca055086 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:16.713372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee14ba863874276a8e67b78ec2eac6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e216dbb7021c446ebdcbb127c5e34017', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:16.714023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.714306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.714584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.715324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:16.715639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:16.717351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739aa20-5826-4941-8618-f3901de6227e tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:16.729287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1008/2039] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:16.732232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.732528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.738777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.739326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d6185f85b34c2f997d4cbb528f8acc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.739618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d6185f85b34c2f997d4cbb528f8acc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.751106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:16.752305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.753533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d6185f85b34c2f997d4cbb528f8acc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.814637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1009/2040] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:16.815638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:16.818526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.830595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760716a3-3992-4d81-9013-fddb301c94d7 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:16.835191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:16.836041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.836320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.836594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] PATH_INFO: `/v3/users/fbf34d02af8b45c3a6b8e7f20e555f09` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.838049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf34d02af8b45c3a6b8e7f20e555f09)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:16.839941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:16.888707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d6185f85b34c2f997d4cbb528f8acc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.889364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d6185f85b34c2f997d4cbb528f8acc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:16.905989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1032/2041] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:16 2022] DELETE /identity/v3/users/95d6185f85b34c2f997d4cbb528f8acc => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:16.907098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:16.908444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:16.979727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fda05d-22d0-4a71-a313-8d7571ba6173 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:16.985093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee14ba863874276a8e67b78ec2eac6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e216dbb7021c446ebdcbb127c5e34017', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:16.985870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:16.986157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:16.986421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:16.987115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:16.989099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.120293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf34d02af8b45c3a6b8e7f20e555f09'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.132569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf34d02af8b45c3a6b8e7f20e555f09'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.174791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1033/2042] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:16 2022] POST /identity/v3/projects => generated 353 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:17.174791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.176078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.235896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa3a62-9e6e-495d-998a-b223c7249c7f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.239664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:17.240264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.240545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.240818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.242600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.277322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf34d02af8b45c3a6b8e7f20e555f09'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.278580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf34d02af8b45c3a6b8e7f20e555f09'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.279240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf34d02af8b45c3a6b8e7f20e555f09'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.297010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1010/2043] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:16 2022] DELETE /identity/v3/users/fbf34d02af8b45c3a6b8e7f20e555f09 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:17.298013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.299375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.308962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:17.310970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.321522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1034/2044] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:17.322428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.323726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.338427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d124ca6-d7dc-4c85-a078-baed446517f3 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.368015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f451f1-65c4-4764-a748-0f5217739965 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.373504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:17.374414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.374705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.374979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] PATH_INFO: `/v3/projects/7e6d9fb5b01e43e69d78883d58771dec` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.376175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6d9fb5b01e43e69d78883d58771dec)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:17.378517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.399797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:17.400711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.400995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.401285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] PATH_INFO: `/v3/users/06292aa2eedb4b1387e12909765957fc` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.402495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] RBAC: Authorizing `identity:delete_user(user_id=06292aa2eedb4b1387e12909765957fc)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:17.405019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.502375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6d9fb5b01e43e69d78883d58771dec', 'request_id': 'req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.508477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6d9fb5b01e43e69d78883d58771dec', 'request_id': 'req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.509825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:17.514842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6d9fb5b01e43e69d78883d58771dec', 'request_id': 'req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.598354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] The token cache is being invalidate because project 7e6d9fb5b01e43e69d78883d58771dec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:17.598354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.598354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.601127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1011/2045] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:17 2022] DELETE /identity/v3/projects/7e6d9fb5b01e43e69d78883d58771dec => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:17.601127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.605241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.616064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06292aa2eedb4b1387e12909765957fc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.616751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06292aa2eedb4b1387e12909765957fc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.630226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06292aa2eedb4b1387e12909765957fc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.691536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c2dca-6a89-43b8-9a8f-ed2e65d3e60e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.697249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee14ba863874276a8e67b78ec2eac6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e216dbb7021c446ebdcbb127c5e34017', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:17.697920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.698228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.698508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.699238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:17.699548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:17.701705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df9161-f00b-477d-ab26-729e920a621f tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.714008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1012/2046] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:17.715107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b95e-20e5-4cd4-91b8-8251b87e87cb None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.716138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b95e-20e5-4cd4-91b8-8251b87e87cb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.716424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc06b95e-20e5-4cd4-91b8-8251b87e87cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.735504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-bc06b95e-20e5-4cd4-91b8-8251b87e87cb None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:17.736622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bc06b95e-20e5-4cd4-91b8-8251b87e87cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.751843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06292aa2eedb4b1387e12909765957fc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.754593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06292aa2eedb4b1387e12909765957fc'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.768765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1035/2047] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:17 2022] DELETE /identity/v3/users/06292aa2eedb4b1387e12909765957fc => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:17.773580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.775211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.797734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1013/2048] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:17.799035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbae28-3f29-4ab8-b6cf-8f341b4b1441 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.799326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbae28-3f29-4ab8-b6cf-8f341b4b1441 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.799618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbae28-3f29-4ab8-b6cf-8f341b4b1441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.818666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dadbae28-3f29-4ab8-b6cf-8f341b4b1441 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:17.820036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dadbae28-3f29-4ab8-b6cf-8f341b4b1441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.845625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f992f-e7db-41c0-af4e-ab5499b2271f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.851322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:17.852275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.852650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.853542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] PATH_INFO: `/v3/projects/bea6c99e126749c09530e19e99f02a1a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.855006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea6c99e126749c09530e19e99f02a1a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:17.857125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:17.888980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1014/2049] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:17.895364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:17.895364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:17.895364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:17.908848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:17.910067 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.917706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1015/2050] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:17.919061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:17.920262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:17.984368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084fa0c-4e6a-44e0-b019-5e7f58250e50 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:17.989407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea6c99e126749c09530e19e99f02a1a', 'request_id': 'req-22ce1169-0486-44a8-b280-0451d5b92394'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.995578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea6c99e126749c09530e19e99f02a1a', 'request_id': 'req-22ce1169-0486-44a8-b280-0451d5b92394'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:17.998974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:18.002311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea6c99e126749c09530e19e99f02a1a', 'request_id': 'req-22ce1169-0486-44a8-b280-0451d5b92394'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.042627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bee14ba863874276a8e67b78ec2eac6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e216dbb7021c446ebdcbb127c5e34017', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.044217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.044509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.044789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] PATH_INFO: `/v3/projects/f8686582636a4d239ae4a4b94e69a0c6` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.046023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f8686582636a4d239ae4a4b94e69a0c6)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.048078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.095328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] The token cache is being invalidate because project bea6c99e126749c09530e19e99f02a1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:18.095744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.096394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.098050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1036/2051] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:17 2022] DELETE /identity/v3/projects/bea6c99e126749c09530e19e99f02a1a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:18.098817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.100140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.156152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce1169-0486-44a8-b280-0451d5b92394 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.159754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.160390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.160671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.160945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.163029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.194107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8686582636a4d239ae4a4b94e69a0c6', 'request_id': 'req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.200608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8686582636a4d239ae4a4b94e69a0c6', 'request_id': 'req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.206164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8686582636a4d239ae4a4b94e69a0c6', 'request_id': 'req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.229968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.232008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.241355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1037/2052] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:18.242956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.244242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.256254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66455c06-84e0-4742-924c-5238cc59a3f3 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.311619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] The token cache is being invalidate because project f8686582636a4d239ae4a4b94e69a0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:18.311832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.312465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-92ba9d59-7ec5-4953-b5e4-48a99b862b6d tempest-VolumeQuotaClassesTest-457256582 tempest-VolumeQuotaClassesTest-457256582-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.314722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.314857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1016/2053] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:17 2022] DELETE /identity/v3/projects/f8686582636a4d239ae4a4b94e69a0c6 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:18.315612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.315942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.316128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.316244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] PATH_INFO: `/v3/projects/f18295dedbe24f03b8ee488c5d715738` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.316417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.316696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.317582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18295dedbe24f03b8ee488c5d715738)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.320250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.351092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:18.352330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.360772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1017/2054] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:18.361697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.365142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.423769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3126bd-6052-4170-a3ce-e1c2d17fbf2d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.427719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.428389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.428679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.428959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.431717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.446991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.448652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098afa4-3cc8-4af5-b9d7-e17446868b32 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.449441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18295dedbe24f03b8ee488c5d715738', 'request_id': 'req-fc16e803-fa11-419a-8550-1b90babfd168'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.458146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18295dedbe24f03b8ee488c5d715738', 'request_id': 'req-fc16e803-fa11-419a-8550-1b90babfd168'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.464968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18295dedbe24f03b8ee488c5d715738', 'request_id': 'req-fc16e803-fa11-419a-8550-1b90babfd168'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.468758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1018/2055] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:18.470253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44a30-0285-4dd5-9fa7-53f0afa72909 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.470618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44a30-0285-4dd5-9fa7-53f0afa72909 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.470994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c44a30-0285-4dd5-9fa7-53f0afa72909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.494993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a2c44a30-0285-4dd5-9fa7-53f0afa72909 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:18.496370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a2c44a30-0285-4dd5-9fa7-53f0afa72909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.569399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] The token cache is being invalidate because project f18295dedbe24f03b8ee488c5d715738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:18.569946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.570351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.572554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1038/2056] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:18 2022] DELETE /identity/v3/projects/f18295dedbe24f03b8ee488c5d715738 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:18.573904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.575861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.579387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1019/2057] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:18.579387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd734c-f871-4931-864b-3e600ed89fe6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.579387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd734c-f871-4931-864b-3e600ed89fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.579387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd734c-f871-4931-864b-3e600ed89fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.594574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e803-fa11-419a-8550-1b90babfd168 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.602294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.602294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.602294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.602294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.602658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e4dd734c-f871-4931-864b-3e600ed89fe6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:18.603319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:18.603447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.603535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e4dd734c-f871-4931-864b-3e600ed89fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.605360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbcba18-0a01-4ea8-8f83-085dfb4cfbad admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.611921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1020/2058] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:18.613186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.613511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.613871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.624427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1039/2059] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:18.625854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.626239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.626595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.633626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:18.634816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.643223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1021/2060] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:18.643982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.645856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:18.647114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.654285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85c15c-19d7-4fe9-b4c1-1a6601d9cb06 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.656365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1040/2061] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:18.657030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.659827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.660166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.660437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.660708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.661429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.663585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.667334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9d81d4-646b-43a4-a122-f9b0aa5226f8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.672183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.672830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.673116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.673423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.674177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:18.674516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.676094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.680561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:18.689532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1041/2062] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:18.694372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.705460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e26ddb8-3ba4-4777-bb19-e1636c6bc185 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.710982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.711841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.712374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.712645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.713502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:18.713818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.716060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.729844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1042/2063] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:18.730770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.732799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:18.747764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e7114-21af-4483-a7b9-fda595688dc3 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.752526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.753481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.753771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.754044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] PATH_INFO: `/v3/projects/0afc2f91394c411fafe093cc678dc12c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.755225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afc2f91394c411fafe093cc678dc12c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.757201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.777329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1022/2064] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:18.778559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:18.846573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5acb3e7-0cf1-478e-a8be-d22408020715 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:18.851486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:18.852229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:18.852582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:18.852922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:18.853750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:18.855823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:18.866961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:18.895499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afc2f91394c411fafe093cc678dc12c', 'request_id': 'req-3c3cc35e-38b1-4804-b10d-c7dc84390d97'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.903575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afc2f91394c411fafe093cc678dc12c', 'request_id': 'req-3c3cc35e-38b1-4804-b10d-c7dc84390d97'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.909597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afc2f91394c411fafe093cc678dc12c', 'request_id': 'req-3c3cc35e-38b1-4804-b10d-c7dc84390d97'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:18.982605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1023/2065] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/projects => generated 357 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:18.983497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.036360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] The token cache is being invalidate because project 0afc2f91394c411fafe093cc678dc12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:19.036661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.037592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.039189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1043/2066] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:18 2022] DELETE /identity/v3/projects/0afc2f91394c411fafe093cc678dc12c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:19.039943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.047631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216660a-25e0-4052-86b8-efaba67ce0ae admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.051138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.053956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.054214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.054543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.054828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.055520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.057665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.119762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cc35e-38b1-4804-b10d-c7dc84390d97 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.124639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.125340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.125628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.125905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.126585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.128503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.182850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1024/2067] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:18 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:19.182850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.184735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.245921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a086301-27b6-41b0-9b9d-f88965617489 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.251353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.252000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.252278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.252551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.253231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.255290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52391812-601b-4d9e-9d04-5f0d5c023034 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.284095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1044/2068] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:19.284769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.286387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.299059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d393325-a93b-451c-bf21-330731ca4560 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.304240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.305118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.305537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.305848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] PATH_INFO: `/v3/projects/8af963b15ee243a9b2fa546b76eae1b1` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.307042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8af963b15ee243a9b2fa546b76eae1b1)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.308942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.394511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1025/2069] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/users => generated 279 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:19.394511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.394511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.394511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.411044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:19.412222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.421502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1026/2070] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:19.422289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.423529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.436737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f61eb3-3c01-499a-b24a-d31edc69129e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.447456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8af963b15ee243a9b2fa546b76eae1b1', 'request_id': 'req-a7b6b348-b6bd-475d-aaf0-433558961993'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.455088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8af963b15ee243a9b2fa546b76eae1b1', 'request_id': 'req-a7b6b348-b6bd-475d-aaf0-433558961993'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.460809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8af963b15ee243a9b2fa546b76eae1b1', 'request_id': 'req-a7b6b348-b6bd-475d-aaf0-433558961993'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.494535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.495410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.495696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.495971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] PATH_INFO: `/v3/users/9321b0c6de844f229dc0b3be3b5cfc36` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.497369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9321b0c6de844f229dc0b3be3b5cfc36)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.500312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.564621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] The token cache is being invalidate because project 8af963b15ee243a9b2fa546b76eae1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:19.564913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.565594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.567181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1045/2071] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:19 2022] DELETE /identity/v3/projects/8af963b15ee243a9b2fa546b76eae1b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:19.567900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.569208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.581702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6b348-b6bd-475d-aaf0-433558961993 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.586346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.587489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.587609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.587842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.588515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.591065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.697342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1046/2072] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:19.697342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.698868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.707192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9321b0c6de844f229dc0b3be3b5cfc36'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.711968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e7e671-36d2-40b2-9386-a974c3ed1ee0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.717803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.718472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.718761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.719044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.719762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.720057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9321b0c6de844f229dc0b3be3b5cfc36'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.721636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.732690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1047/2073] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:19.733603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.735257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.748232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03a382-00af-40b3-975d-58e45b8bbc90 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.752788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.753450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.753740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.754023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.754734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.756305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe677a-1a1a-4dd1-a0ad-0d371b4c9776 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.767628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1048/2074] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:19.768965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.769282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.769560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.787671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:19.788904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.791305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9321b0c6de844f229dc0b3be3b5cfc36'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.792025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9321b0c6de844f229dc0b3be3b5cfc36'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.792735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9321b0c6de844f229dc0b3be3b5cfc36'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:19.798588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1049/2075] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:19.799927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.800793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.809814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1027/2076] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:19 2022] DELETE /identity/v3/users/9321b0c6de844f229dc0b3be3b5cfc36 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:19.810452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.812012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.813449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2837a1-dd0a-4810-90dd-2e93228866d4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.870348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.871227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.871516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.872019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] PATH_INFO: `/v3/users/46015226b9e04fba8725a5f6797d112e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.873316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46015226b9e04fba8725a5f6797d112e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.875252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.877285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960664a-2af8-42b1-a546-3089ec57f979 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.881944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.882638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.882923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.883210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.883936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.885580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.899393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1028/2077] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:19.899393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.899393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.912363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdbb1-0683-48a8-bf24-a4caf0cf4269 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.917248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.917923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.918209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.918642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.919551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.921168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.931036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1029/2078] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:19.931811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.933541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:19.945747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ca81c-0903-4011-ae0b-2390e08324bd admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.950944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.951494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.951772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.952044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.952750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.954353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.964058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1030/2079] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:19.964815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:19.974804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af12918-dcda-4411-a65b-d44c6cf48dce admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:19.979575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:19.980195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.980481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.980793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:19.982044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:19.982044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:19.983712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9690f47e-589e-4a91-bb51-a706097fbc88 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:19.997586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1031/2080] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:19.998929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:19.999212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:19.999491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.016810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:20.018035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.025644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1032/2081] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:20.026602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.037152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2130a5-161c-4f07-ba52-cedcd0fb24dc None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.042652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.042652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.042849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.043099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.043920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.045554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.058618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1033/2082] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:20.058618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.067373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26543d26-0b27-41a1-9293-902f5a7bb1ef admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.072968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.073844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.074129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.074405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] PATH_INFO: `/v3/projects/c2189f79630f44e899662e631f6d1366/users/b29a0bbc71134f379f69ccd5e41f645b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.077811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46015226b9e04fba8725a5f6797d112e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.079223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46015226b9e04fba8725a5f6797d112e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.088861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:20.092472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46015226b9e04fba8725a5f6797d112e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.097944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2189f79630f44e899662e631f6d1366, user_id=b29a0bbc71134f379f69ccd5e41f645b, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.100885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.199047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46015226b9e04fba8725a5f6797d112e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.200182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46015226b9e04fba8725a5f6797d112e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.205786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1034/2083] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:20 2022] PUT /identity/v3/projects/c2189f79630f44e899662e631f6d1366/users/b29a0bbc71134f379f69ccd5e41f645b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:20.206523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.208124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.217151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1050/2084] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:19 2022] DELETE /identity/v3/users/46015226b9e04fba8725a5f6797d112e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:20.218397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.221720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.289670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c178d2c2-341b-4769-bcdd-62931d5046a2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.289886 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca7ec3f-19e5-4133-81b4-fab17dbaed47 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.294846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.295752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.296047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.296329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] PATH_INFO: `/v3/projects/464e8c4dcac04029bbbbf9b3457f8eb0/users/80560f93b6ec4eee95a47991336fcf18/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.297695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.298366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.298843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.299131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.300257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.301910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.312266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=464e8c4dcac04029bbbbf9b3457f8eb0, user_id=80560f93b6ec4eee95a47991336fcf18, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.315170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.405527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1035/2085] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:20 2022] PUT /identity/v3/projects/464e8c4dcac04029bbbbf9b3457f8eb0/users/80560f93b6ec4eee95a47991336fcf18/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:20.406445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.415310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.417173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1051/2086] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:20 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:20.417899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.420248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.483812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b9a0b-6510-4c29-bc51-1d95ef802274 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.493427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d382d-56e1-4106-81e2-b48a892bdcb2 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.498892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.499841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.500196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.500399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] PATH_INFO: `/v3/projects/4900cb40b3dd4b6c86bd8aebb12e02bf/users/de178dd201e2439bb4bb7414dd9334d0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.515406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4900cb40b3dd4b6c86bd8aebb12e02bf, user_id=de178dd201e2439bb4bb7414dd9334d0, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.518957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed14a1-56c6-4e04-b169-bdaed658aaec admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.539983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.540640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.540930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.541207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.543100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.556493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.558004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3363e744-f0b6-49e3-b009-0d4d178ba323 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.567802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1036/2087] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:20.569074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.569462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.569748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.595704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1052/2088] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:20 2022] PUT /identity/v3/projects/4900cb40b3dd4b6c86bd8aebb12e02bf/users/de178dd201e2439bb4bb7414dd9334d0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:20.597243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881888-aa74-4963-8534-c2f1d561e98b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.597700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881888-aa74-4963-8534-c2f1d561e98b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.598091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93881888-aa74-4963-8534-c2f1d561e98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.607849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] MFA Rules not processed for user `b29a0bbc71134f379f69ccd5e41f645b`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:20.609080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.625702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-93881888-aa74-4963-8534-c2f1d561e98b None None] MFA Rules not processed for user `80560f93b6ec4eee95a47991336fcf18`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:20.627078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-93881888-aa74-4963-8534-c2f1d561e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.682962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1037/2089] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:20.683943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.726771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1053/2090] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:20 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:20.730267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.730561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.730831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.763305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] MFA Rules not processed for user `de178dd201e2439bb4bb7414dd9334d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:20.764631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.785334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97a381-bc76-4395-aee3-8340af112434 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.790261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.790926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.791211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.791487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.792171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.794155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.829729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1054/2091] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:20.830717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.832013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.846450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38abffc-346e-41a8-b33a-c735447ccadd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:20.851388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:20.853170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:20.861810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:20.861810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:20.861810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] PATH_INFO: `/v3/projects/88b1cd5539884753bb3383fd19b38a0f` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:20.861810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b1cd5539884753bb3383fd19b38a0f)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:20.861810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:20.939041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1038/2092] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:20 2022] POST /identity/v3/users => generated 282 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:20.939041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:20.940053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:20.993571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b1cd5539884753bb3383fd19b38a0f', 'request_id': 'req-e41f576e-49a3-4969-87e1-2e3b91a06e5e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:20.999421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b1cd5539884753bb3383fd19b38a0f', 'request_id': 'req-e41f576e-49a3-4969-87e1-2e3b91a06e5e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.003730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344771a6-aace-4c76-a43e-cc743343a750 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.005187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b1cd5539884753bb3383fd19b38a0f', 'request_id': 'req-e41f576e-49a3-4969-87e1-2e3b91a06e5e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.053789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.054454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.054741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.055022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.101549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] The token cache is being invalidate because project 88b1cd5539884753bb3383fd19b38a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:21.102015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.102703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.104325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1055/2093] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:20 2022] DELETE /identity/v3/projects/88b1cd5539884753bb3383fd19b38a0f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:21.105131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.106633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.114218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.115673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.125743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1039/2094] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:21.126570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.127927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.138947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021267b-faf9-4f63-b544-656b50383849 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.142927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.143598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.143881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.144155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.155249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.189644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f576e-49a3-4969-87e1-2e3b91a06e5e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.196480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.197162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.197484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.197806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.198757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.203755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.231249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.233056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.242924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1040/2095] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:21.244576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.246374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.261046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fe5de-0e35-4374-bcba-7ac6b6d461ca service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.267792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.268752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.269113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.269502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.270269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.271896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9acfbb-b5c4-4fca-8055-c571f557614c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.286197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1041/2096] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:21.286197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.286197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.286197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.306270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:21.307634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.317828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1042/2097] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:21.318625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.319959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.334428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d57b0-ef38-4910-8fb9-6589f6053276 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.334796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1056/2098] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:21 2022] POST /identity/v3/projects => generated 355 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:21.335785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.337865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.395442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.396326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.396613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.396890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] PATH_INFO: `/v3/users/b29a0bbc71134f379f69ccd5e41f645b` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.398207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29a0bbc71134f379f69ccd5e41f645b)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.400135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.408372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551462c-b8e1-4f11-ad55-17674f53c032 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.413143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.414042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.414331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.414650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] PATH_INFO: `/v3/projects/07ca08df59d14130af9f5928c36aca35` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.415818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07ca08df59d14130af9f5928c36aca35)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.417799 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.635387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29a0bbc71134f379f69ccd5e41f645b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.635723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07ca08df59d14130af9f5928c36aca35', 'request_id': 'req-982bc3f2-57e3-4de9-8b21-9302341d07d2'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.642590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07ca08df59d14130af9f5928c36aca35', 'request_id': 'req-982bc3f2-57e3-4de9-8b21-9302341d07d2'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.648681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07ca08df59d14130af9f5928c36aca35', 'request_id': 'req-982bc3f2-57e3-4de9-8b21-9302341d07d2'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.648831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29a0bbc71134f379f69ccd5e41f645b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.736079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29a0bbc71134f379f69ccd5e41f645b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.736702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29a0bbc71134f379f69ccd5e41f645b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.737391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29a0bbc71134f379f69ccd5e41f645b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.750803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1043/2099] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:21 2022] DELETE /identity/v3/users/b29a0bbc71134f379f69ccd5e41f645b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:21.754577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.755917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.817589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4df32b-7373-4f82-ab1b-03d186be5aba admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.822130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.822889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.827800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.827800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.827800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.828081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] The token cache is being invalidate because project 07ca08df59d14130af9f5928c36aca35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:21.828174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.828269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.828269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-982bc3f2-57e3-4de9-8b21-9302341d07d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:21.828762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1057/2100] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:21 2022] DELETE /identity/v3/projects/07ca08df59d14130af9f5928c36aca35 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:21.830016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac513d-63d6-4b36-8c09-db6b1b543ecc None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.830298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac513d-63d6-4b36-8c09-db6b1b543ecc None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.830569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac513d-63d6-4b36-8c09-db6b1b543ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.836710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1044/2101] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:21.837910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.839571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.847778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:21.856021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2aac513d-63d6-4b36-8c09-db6b1b543ecc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:21.857974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2aac513d-63d6-4b36-8c09-db6b1b543ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.858267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4dc32-c42e-456c-bf4b-c3eecd552ba1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.862918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.863582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.863866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.864144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.864969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.869438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1058/2102] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:21.869579 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.869658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.869658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.869658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.885369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:21.886543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.894486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1059/2103] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:21.896645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.896896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.909813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b347ad-eec0-4571-90fc-547e67474a0f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.914464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.915350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.915666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.915938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] PATH_INFO: `/v3/users/bee14ba863874276a8e67b78ec2eac6e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:21.917132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bee14ba863874276a8e67b78ec2eac6e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:21.919950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:21.959957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1045/2104] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:21 2022] POST /identity/v3/users => generated 284 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:21.961405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:21.964098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:21.965128 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:21.978213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf5111-c20d-41d8-9fe3-49579097a192 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:21.983867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:21.984764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:21.985050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:21.985367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] PATH_INFO: `/v3/projects/0fb6dfda63bb4de4b973f80027906fb6/users/e19a4b41e4054518a808d9a90c277b5e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.000658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb6dfda63bb4de4b973f80027906fb6, user_id=e19a4b41e4054518a808d9a90c277b5e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.003547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.100710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1046/2105] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:21 2022] PUT /identity/v3/projects/0fb6dfda63bb4de4b973f80027906fb6/users/e19a4b41e4054518a808d9a90c277b5e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:22.101609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.165426 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3188bc-be9b-4a0d-aad8-6548b4c3d388 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.170367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.171060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.171368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.171649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.172379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:22.172689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.174374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.186133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1047/2106] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:22.186959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.188690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:22.195773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bee14ba863874276a8e67b78ec2eac6e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:22.196425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bee14ba863874276a8e67b78ec2eac6e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:22.208883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bee14ba863874276a8e67b78ec2eac6e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:22.246331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a6d26-75b7-4a57-9e7b-9d7e0dc3d4bc admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.250026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.250668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.250953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.251228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.260543 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.262022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.267744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bee14ba863874276a8e67b78ec2eac6e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:22.268828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd13dc77-55ae-4a06-9d13-555351d40fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bee14ba863874276a8e67b78ec2eac6e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:22.272788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1048/2107] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:22.273523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.283804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247af823-29d7-4ebe-99bc-52ddd7b1b878 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.285470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1060/2108] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:21 2022] DELETE /identity/v3/users/bee14ba863874276a8e67b78ec2eac6e => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:22.287145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.287443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.287727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.318938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] MFA Rules not processed for user `e19a4b41e4054518a808d9a90c277b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:22.320234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:22.350307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.354272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.354272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.354272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.354272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.354738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.370500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1049/2109] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:22.370500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.374102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:22.391387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c12d24-27ac-4a43-89cb-e0a89e947197 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.398937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.399288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.399664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.399885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.400611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.403108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.409502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1061/2110] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:22.414077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.416088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:22.433195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949e453-fa51-4562-80c5-14b6f02a19b3 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.438929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.439830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.440116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.440580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] PATH_INFO: `/v3/projects/0a47a9e0c33d404b82dda27d3061be48/users/399a31a0db5a4067bf3ce1f4bd4c1627/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.456821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a47a9e0c33d404b82dda27d3061be48, user_id=399a31a0db5a4067bf3ce1f4bd4c1627, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.459556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.493980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1050/2111] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:22.494828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.496503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:22.568557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b860f-4196-4600-a79d-8075d3deee07 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.571868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1062/2112] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:22 2022] PUT /identity/v3/projects/0a47a9e0c33d404b82dda27d3061be48/users/399a31a0db5a4067bf3ce1f4bd4c1627/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:22.574114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.630505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.631710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.632001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.632291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.633020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.635214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.644957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d7e18-0cdc-4692-9dba-03912edf9cbf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.651273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.651991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.652259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.652574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.653669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.655756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.733398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1051/2113] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:22.737304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.769966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1063/2114] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:22.769966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.787287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0f22-8e07-4e47-bc07-c26e2902a693 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.820128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3620a7e-b6f4-4c8f-9510-f298146233f1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.825767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.826534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.826821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.827127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.827883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.829544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.841329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1052/2115] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:22.842170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.852080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855e58f-27f7-438a-a013-fba2adee5894 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.857615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.858264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.858544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.858818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.859530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.860665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.861241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.861395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.861679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.861963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.862659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.864623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.871434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1053/2116] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:22.873228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.883051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4266600-c9fb-487a-9934-b8cca6079f54 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.887742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.888595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.888884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.889159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] PATH_INFO: `/v3/projects/0a47a9e0c33d404b82dda27d3061be48/users/399a31a0db5a4067bf3ce1f4bd4c1627/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.891140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a47a9e0c33d404b82dda27d3061be48, user_id=399a31a0db5a4067bf3ce1f4bd4c1627, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.893801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.904361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1054/2117] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:22 2022] PUT /identity/v3/projects/0a47a9e0c33d404b82dda27d3061be48/users/399a31a0db5a4067bf3ce1f4bd4c1627/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:22.905124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.970571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8eb71-aa21-42b7-9fd0-aec029bb46e0 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:22.975500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:22.976151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.976451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.976711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.977594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:22.979261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f7cf4-60b3-4e1d-b34c-3c6eb17a0740 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:22.990227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1055/2118] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:22.991614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e506f-0889-429c-a193-2be194f752b7 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:22.991912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e506f-0889-429c-a193-2be194f752b7 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:22.992194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928e506f-0889-429c-a193-2be194f752b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:22.995430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1064/2119] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:22.996342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:22.999177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.011503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c1758-f90a-4bef-bda8-199c74316b2f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.016678 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.017677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.017959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.018293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] PATH_INFO: `/v3/projects/e216dbb7021c446ebdcbb127c5e34017` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.019974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e216dbb7021c446ebdcbb127c5e34017)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.020099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-928e506f-0889-429c-a193-2be194f752b7 None None] MFA Rules not processed for user `399a31a0db5a4067bf3ce1f4bd4c1627`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.021231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-928e506f-0889-429c-a193-2be194f752b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.022721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.094382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1056/2120] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:22 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.095262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e506f-0889-429c-a193-2be194f752b7 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.096591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-928e506f-0889-429c-a193-2be194f752b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.110772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928e506f-0889-429c-a193-2be194f752b7 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.115604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.116495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.116776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.117053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] PATH_INFO: `/v3/projects/c2189f79630f44e899662e631f6d1366` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.118454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2189f79630f44e899662e631f6d1366)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.120502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.136731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e216dbb7021c446ebdcbb127c5e34017', 'request_id': 'req-47992984-b047-447d-b41a-74a05ea5c07e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.143289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e216dbb7021c446ebdcbb127c5e34017', 'request_id': 'req-47992984-b047-447d-b41a-74a05ea5c07e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.148824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e216dbb7021c446ebdcbb127c5e34017', 'request_id': 'req-47992984-b047-447d-b41a-74a05ea5c07e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.262495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] The token cache is being invalidate because project e216dbb7021c446ebdcbb127c5e34017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:23.262772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.263440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.266485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1065/2121] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:22 2022] DELETE /identity/v3/projects/e216dbb7021c446ebdcbb127c5e34017 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:23.266485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.270580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.275041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2189f79630f44e899662e631f6d1366', 'request_id': 'req-7de85447-5764-4c64-bfef-08761c59ae69'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.285172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2189f79630f44e899662e631f6d1366', 'request_id': 'req-7de85447-5764-4c64-bfef-08761c59ae69'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.291046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2189f79630f44e899662e631f6d1366', 'request_id': 'req-7de85447-5764-4c64-bfef-08761c59ae69'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.338943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47992984-b047-447d-b41a-74a05ea5c07e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.394548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.395369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.395653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.395932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] PATH_INFO: `/v3/projects/29ce14baaafe4449bf9ee4e3002f2648/users/87442723deb84646bdfcec0e26e1ff85/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.410813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29ce14baaafe4449bf9ee4e3002f2648, user_id=87442723deb84646bdfcec0e26e1ff85, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.413564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfa2aa-7e41-457c-824f-07e8b8e0f3f4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.419530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] The token cache is being invalidate because project c2189f79630f44e899662e631f6d1366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:23.419830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.422093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:23.423734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1057/2122] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:23 2022] DELETE /identity/v3/projects/c2189f79630f44e899662e631f6d1366 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:23.424768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.426991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.439070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de85447-5764-4c64-bfef-08761c59ae69 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.443797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.444352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.444729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.444889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.445673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.447264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.458033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1058/2123] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:23.458866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.461353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.492333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1066/2124] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:23 2022] PUT /identity/v3/projects/29ce14baaafe4449bf9ee4e3002f2648/users/87442723deb84646bdfcec0e26e1ff85/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:23.502926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac64d-b7ad-4d51-9ac9-12d7d6299e14 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.503216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac64d-b7ad-4d51-9ac9-12d7d6299e14 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.503497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bac64d-b7ad-4d51-9ac9-12d7d6299e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.523448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-22bac64d-b7ad-4d51-9ac9-12d7d6299e14 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.523887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-22bac64d-b7ad-4d51-9ac9-12d7d6299e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.525138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde237-9798-40a1-b340-94176a6cd904 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.576077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.576779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.577012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.577321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.579164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.588380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1067/2125] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.589701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.589988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.590864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.618317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.619733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.629932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1068/2126] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.631192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.647722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb1505-0ab9-4e60-9cff-c44ddfdb460c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.653612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.654330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.654837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.655787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775b293-3587-48cf-b40f-3decc7dd1e26 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.659927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.660238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] PATH_INFO: `/v3/projects/155fec5f51da448b9ace2bbd1ac10897/users/a18271dfd0e142f29d1a2d8b6765bac9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.666443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1059/2127] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:23.667595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0f96-1699-4a65-b0cd-be5a84dccc43 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.667881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0f96-1699-4a65-b0cd-be5a84dccc43 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.668157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb0f96-1699-4a65-b0cd-be5a84dccc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.677273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155fec5f51da448b9ace2bbd1ac10897, user_id=a18271dfd0e142f29d1a2d8b6765bac9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.680121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54243b-719d-44f3-a5de-dc690d823cc1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.696908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-14fb0f96-1699-4a65-b0cd-be5a84dccc43 None None] MFA Rules not processed for user `87442723deb84646bdfcec0e26e1ff85`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.698246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-14fb0f96-1699-4a65-b0cd-be5a84dccc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.708450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:23.737479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1069/2128] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:23 2022] PUT /identity/v3/projects/155fec5f51da448b9ace2bbd1ac10897/users/a18271dfd0e142f29d1a2d8b6765bac9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:23.738864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.739157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.739457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.759347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.760565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.795734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1060/2129] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.797458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.797733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.798019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.802725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:23.818060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:23.819262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.845736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1070/2130] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.846672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.862835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f416251-31d7-4e0b-aa94-c45964cfa120 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.871238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.871238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.872869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.872869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.873786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.875405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.883586 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1061/2131] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:23.884716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.886088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:23.887418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1071/2132] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:23.888335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.898620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81398d9b-e670-4bbc-a2a8-12c8f43a935f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.898763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d0554-12f2-4eb3-bdc0-fa063ea0cfb6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.903423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.903572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.904075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.904526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.904636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.904730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.904811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.904892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.905427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:23.905592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.905741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:23.907337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.907570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:23.921141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1072/2133] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:23.925432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:23.981589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00ed8c-d129-4288-89fa-e33123ffa701 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:23.985383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:23.986072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:23.986360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:23.986641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:23.988520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:24.012783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1062/2134] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:23 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.013571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.062714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.064211 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.073671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1073/2135] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:23 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:24.076497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.084627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fcee3-fd6e-4c09-9320-ddb6150a169b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.086877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db1ce9-9031-4d27-a8c8-1be1add18a1b service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.091107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.091867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.092158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.092439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.093311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:24.093421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.093629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.094269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.094552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.094829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] PATH_INFO: `/v3/projects/155fec5f51da448b9ace2bbd1ac10897/users/a18271dfd0e142f29d1a2d8b6765bac9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.095330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.097393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=155fec5f51da448b9ace2bbd1ac10897, user_id=a18271dfd0e142f29d1a2d8b6765bac9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.099736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.114701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1074/2136] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:24 2022] PUT /identity/v3/projects/155fec5f51da448b9ace2bbd1ac10897/users/a18271dfd0e142f29d1a2d8b6765bac9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:24.114701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.118729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1063/2137] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:24.119617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.134403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d4fb7-1fe3-4403-8a23-af35e9e062f7 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.188180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44c03f-104f-42fb-9b02-613fcefca002 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.192835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.200445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.200569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.200569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.200569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.200784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.200784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.200784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.201001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.201081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.201173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f326dce-710f-4ae5-a946-6eea13ff95a6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.201361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.332077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1064/2138] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.332659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.343666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61903d70-8eb9-44ed-a43f-637686f255fa admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.348252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.348889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.349171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.349477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.350143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.352283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.364935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1075/2139] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/projects => generated 399 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.364935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.364935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.364935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.390873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] MFA Rules not processed for user `a18271dfd0e142f29d1a2d8b6765bac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:24.392073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:24.457814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1065/2140] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.459132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.472603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1076/2141] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:24.473676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.527045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90def8c2-8296-40d3-8714-442673d3142d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.532271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.533162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.533465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.533743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.534522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.536130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.545174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3e1d4-2f5f-43c4-afdb-f3bd295a8e34 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.548813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1066/2142] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.549685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.556863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.561540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.561540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.561540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.561540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.562234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.563037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cf4a0-0611-49e8-885b-aef0aa7f84dc admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.568964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.569674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.569957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.570245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.570962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.573006 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.662569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1067/2143] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.663627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.665027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1077/2144] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:24 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:24.665027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.669787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:24.677939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bdbeda-45b0-4373-81aa-7335cf4a43d6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.683261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.685175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.685736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.686031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] PATH_INFO: `/v3/projects/44630288d50a466fabfe46350d33625f/users/1d36436720164ee6afa0988387df260b/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.701759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44630288d50a466fabfe46350d33625f, user_id=1d36436720164ee6afa0988387df260b, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.704578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.730017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d165cc-ad7d-40dc-ad41-232fdf3712a2 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.734693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.735348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.735633 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.742453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.798848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1068/2145] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:24 2022] PUT /identity/v3/projects/44630288d50a466fabfe46350d33625f/users/1d36436720164ee6afa0988387df260b/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:24.799059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.800291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.802395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.812108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1078/2146] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:24.813331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.824734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e285c-765e-4b78-8f0f-34d86b7e97ac service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.875108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7d115-fe76-4d6e-b4d8-3dd0003bb309 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.880308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.881107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.881459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.881726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.882428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.884048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.892939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.893648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.893933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.894768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.895543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.899315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1069/2147] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.899315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.899536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.909475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8aa0b-ca9a-481e-b3d4-8238b0179a90 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.910051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1079/2148] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.911029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.918285 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.920136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.920136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.922129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.922129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.923001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.930397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31045c4c-033e-4304-a71e-cec1f45d16e8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.935329 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.936010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.936296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.936575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.937327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.938950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.941366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1070/2149] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.942390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.954571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1080/2150] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.955604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.956836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73172279-70ae-42c2-a719-18cf6b91efd8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.969409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.970126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.970436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.970746 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.971484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.973120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.974621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0f323-f4fb-4d3d-ba9f-130f4f3bcef0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.979247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:24.980189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:24.980403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:24.980677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] PATH_INFO: `/v3/projects/44630288d50a466fabfe46350d33625f/users/1d36436720164ee6afa0988387df260b/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:24.983297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44630288d50a466fabfe46350d33625f, user_id=1d36436720164ee6afa0988387df260b, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:24.984649 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1071/2151] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:24.985508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:24.985755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:24.997924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83289-1c9f-45e5-aaf1-5ba4fa3e9ee2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:24.998975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1081/2152] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:24 2022] PUT /identity/v3/projects/44630288d50a466fabfe46350d33625f/users/1d36436720164ee6afa0988387df260b/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:24.999966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.059949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.060941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.061319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.061652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] PATH_INFO: `/v3/projects/3f91679e053a4582945dcbace6c93d24/users/2fe22b57fdec43aba874cc1589e84e1a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.071388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b360b-25c0-4178-9326-b36050b05849 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.077538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.078336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.078623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.078898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] PATH_INFO: `/v3/projects/238fbf5ebff5473d87cf32c35857b958/users/065afb491f5d409fa928f3cbc24f75e4/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.079089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f91679e053a4582945dcbace6c93d24, user_id=2fe22b57fdec43aba874cc1589e84e1a, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.082035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144accc-40e2-4207-89f1-0f54f42418da admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.097458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=238fbf5ebff5473d87cf32c35857b958, user_id=065afb491f5d409fa928f3cbc24f75e4, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.100262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2665a-1f06-490a-adc9-48d8ae1ce298 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.159614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1082/2153] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:24 2022] PUT /identity/v3/projects/238fbf5ebff5473d87cf32c35857b958/users/065afb491f5d409fa928f3cbc24f75e4/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:25.160218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1072/2154] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:24 2022] PUT /identity/v3/projects/3f91679e053a4582945dcbace6c93d24/users/2fe22b57fdec43aba874cc1589e84e1a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:25.161182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.161569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.162097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.164952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc877a8a-228b-429b-a611-3117f824173c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.165320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc877a8a-228b-429b-a611-3117f824173c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.165612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc877a8a-228b-429b-a611-3117f824173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.183496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fc877a8a-228b-429b-a611-3117f824173c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:25.184863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fc877a8a-228b-429b-a611-3117f824173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:25.189974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] MFA Rules not processed for user `1d36436720164ee6afa0988387df260b`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:25.194490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:25.256818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1073/2155] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:25.260136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.260136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.260136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.268959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1083/2156] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:25.269935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.271209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:25.290135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] MFA Rules not processed for user `065afb491f5d409fa928f3cbc24f75e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:25.291363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:25.318259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:25.332390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d32ee4-e452-45ee-9acf-22dc9d4bad19 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.336509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.338581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.338581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.338581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.348858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.350415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.360473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1084/2157] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:25.371345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1074/2158] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:25.371345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.371889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.377526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0ce77-6eb3-4d78-92e5-faa774ef0a67 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.383889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.384727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.385076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.385456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.386227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.386753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:25.388954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.426209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788aff4f-a838-479c-a101-117b1bc4d5ef service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.430214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.430738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.431026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.431389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.490181 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1075/2159] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:25 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:25.494428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.517603 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.526731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.546399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1085/2160] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:25.576772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba8a3f-6ae0-4b57-89e2-18a60298b491 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.581609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.582369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.582724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.583069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.583821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.585840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.693907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.693907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:25.704034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc299-f7e1-4956-93f5-9ecfb1b84f8d service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.709572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.710977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.711324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.711608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] PATH_INFO: `/v3/users/de178dd201e2439bb4bb7414dd9334d0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.714077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de178dd201e2439bb4bb7414dd9334d0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.716400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.718676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1076/2161] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:25 2022] POST /identity/v3/users => generated 307 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:25.722933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.734020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59467f5-a3be-423c-a63a-fa55237b1851 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.747197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.747197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.747197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.747197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.747613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.747613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.755684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1077/2162] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:25.759921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.772533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d6315-35d7-46d3-be37-d5ec0c798eee admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.777563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.778777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.779148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.779422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] PATH_INFO: `/v3/projects/20504334e43e4ba78110d0da09f19e3b/users/97c684aa2b9243228619561771654ea9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.797509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20504334e43e4ba78110d0da09f19e3b, user_id=97c684aa2b9243228619561771654ea9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.800235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.862537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:25.869216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1078/2163] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:25 2022] PUT /identity/v3/projects/20504334e43e4ba78110d0da09f19e3b/users/97c684aa2b9243228619561771654ea9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:25.870317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:25.945302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13786d76-a5e2-4ae1-abdd-954960e65159 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:25.950930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:25.952156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:25.952274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:25.952553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] PATH_INFO: `/v3/users/e19a4b41e4054518a808d9a90c277b5e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:25.954177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19a4b41e4054518a808d9a90c277b5e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:25.955729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:25.957991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de178dd201e2439bb4bb7414dd9334d0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:25.958779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de178dd201e2439bb4bb7414dd9334d0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:25.999157 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de178dd201e2439bb4bb7414dd9334d0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.109485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de178dd201e2439bb4bb7414dd9334d0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.110160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de178dd201e2439bb4bb7414dd9334d0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.127586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1086/2164] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:25 2022] DELETE /identity/v3/users/de178dd201e2439bb4bb7414dd9334d0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:26.128513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.130570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.201696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fceed6-aa18-477f-86ae-baf330bf0e6d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.206518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.207203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.207490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.207767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.209386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.211882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c1e65-71d3-4cce-ae00-1ba794c27cc3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:26.229867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1087/2165] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:26.229867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.230235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.230347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.245882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19a4b41e4054518a808d9a90c277b5e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.255632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:26.257403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.272411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1088/2166] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:26.273445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.283924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19a4b41e4054518a808d9a90c277b5e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.291989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980a24d-443c-4de2-952d-ad4f0f5c9ed9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.299014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.300364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.300550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.300813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] PATH_INFO: `/v3/projects/20504334e43e4ba78110d0da09f19e3b/users/97c684aa2b9243228619561771654ea9/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.303067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20504334e43e4ba78110d0da09f19e3b, user_id=97c684aa2b9243228619561771654ea9, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.306096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:26.318403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1089/2167] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:26 2022] PUT /identity/v3/projects/20504334e43e4ba78110d0da09f19e3b/users/97c684aa2b9243228619561771654ea9/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:26.319319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.320880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.377538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19a4b41e4054518a808d9a90c277b5e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.381289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19a4b41e4054518a808d9a90c277b5e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.381595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e3604655-92ba-4916-a606-bd9f5ba5591c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19a4b41e4054518a808d9a90c277b5e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:26.390694 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656020a5-9307-464c-b3b0-a5286b9f81b8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.395470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.396141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.396429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.396716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.400226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.408801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1079/2168] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:25 2022] DELETE /identity/v3/users/e19a4b41e4054518a808d9a90c277b5e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:26.408801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.408801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.408801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.440945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] MFA Rules not processed for user `97c684aa2b9243228619561771654ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:26.442879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.452051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:26.497772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.499158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285ebb7-c588-48d8-a054-24e733bb9b9c service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:26.509984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1090/2169] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:26.511251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.511717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.512778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.544761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:26.546105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.556959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1080/2170] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:26.567456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.569560 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.627108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1091/2171] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:26.632639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c05d375-6b88-49b9-9ddf-98cbeba0b081 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.636334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.636660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.637531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.637860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.638098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.638862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.647589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.649014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a865e6c-2647-48a9-a624-d90c053e485b service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:26.659039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1081/2172] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:26.704347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b28eb-08d5-4dab-9806-9a3dfe7e9d4e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.712891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.714021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.714704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.715202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.727557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.731978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:26.741347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1092/2173] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:26.819149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.819446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.819721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.855620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] MFA Rules not processed for user `2fe22b57fdec43aba874cc1589e84e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:26.857656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.914436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.933163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a983e5b4-1b45-4f16-bcd8-355b0eeae1b9 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.940300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.941170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.941578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.941865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.943978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.947689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1082/2174] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:26.959053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:26.960424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:26.975032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928b95d-fbcc-4027-ac98-abb891eece67 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:26.978819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:26.979467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:26.979752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:26.980032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:26.989600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:26.991037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.001574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1083/2175] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:27.016131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.017597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.026803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1093/2176] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:27.094766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.096322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.117037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07814d2-8974-475f-9a30-d1d09adbb65f service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.123431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.124688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.125115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.125559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] PATH_INFO: `/v3/projects/4900cb40b3dd4b6c86bd8aebb12e02bf` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.127155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4900cb40b3dd4b6c86bd8aebb12e02bf)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.129885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.156468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:27.287723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4900cb40b3dd4b6c86bd8aebb12e02bf', 'request_id': 'req-37186d55-1cb8-47b1-b259-7cbfab154312'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.297411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4900cb40b3dd4b6c86bd8aebb12e02bf', 'request_id': 'req-37186d55-1cb8-47b1-b259-7cbfab154312'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.301186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4900cb40b3dd4b6c86bd8aebb12e02bf', 'request_id': 'req-37186d55-1cb8-47b1-b259-7cbfab154312'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.364605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.366072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.386507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee841b8-634a-44c1-a0f1-01326aedeb54 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.401074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] The token cache is being invalidate because project 4900cb40b3dd4b6c86bd8aebb12e02bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:27.401393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.402270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-37186d55-1cb8-47b1-b259-7cbfab154312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.412117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1084/2177] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:27 2022] DELETE /identity/v3/projects/4900cb40b3dd4b6c86bd8aebb12e02bf => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:27.416881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3726-2d2e-4073-97cd-b9d2465ab8f0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.417379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3726-2d2e-4073-97cd-b9d2465ab8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.417738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3726-2d2e-4073-97cd-b9d2465ab8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.446241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d41d3726-2d2e-4073-97cd-b9d2465ab8f0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:27.447905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d41d3726-2d2e-4073-97cd-b9d2465ab8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.468901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.469924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.470718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.471129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] PATH_INFO: `/v3/projects/0fb6dfda63bb4de4b973f80027906fb6` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.472457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb6dfda63bb4de4b973f80027906fb6)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.474509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.514325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1085/2178] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:27.522487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.522778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.523058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.550196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:27.550196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.557691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1086/2179] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:27.562467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.571517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e15b8-2f03-441b-a014-8de1e5bef0d6 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.576427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.577066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.577387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.577664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.578382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:27.578689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.580274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.592380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1087/2180] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:39:27.598567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.608628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3d5f-9893-4391-a832-5500d0a37cd8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.613203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.613847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.614134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.614415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.615087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.616946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.644672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb6dfda63bb4de4b973f80027906fb6', 'request_id': 'req-923187fc-6c98-48c8-866d-090673cc5d8f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.650895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb6dfda63bb4de4b973f80027906fb6', 'request_id': 'req-923187fc-6c98-48c8-866d-090673cc5d8f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.656636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb6dfda63bb4de4b973f80027906fb6', 'request_id': 'req-923187fc-6c98-48c8-866d-090673cc5d8f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.715023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1088/2181] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:27 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:27.719811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.754830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] The token cache is being invalidate because project 0fb6dfda63bb4de4b973f80027906fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:27.755761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.756566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:27.758764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1094/2182] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:27 2022] DELETE /identity/v3/projects/0fb6dfda63bb4de4b973f80027906fb6 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:27.762732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.764495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.797851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd0fb4-bec2-447c-a960-a1debe8fc36b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.803963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.804803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.805091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.805406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.806128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.808063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.852184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923187fc-6c98-48c8-866d-090673cc5d8f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.858352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.859310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.859681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.860029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] PATH_INFO: `/v3/users/a18271dfd0e142f29d1a2d8b6765bac9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:27.861445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18271dfd0e142f29d1a2d8b6765bac9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:27.863455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:27.962965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1089/2183] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:27 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:27.966715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:27.970825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:27.985037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c2366-ef73-45aa-bda4-c9e556366951 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:27.997179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:27.998469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:27.999014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:27.999489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.000739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.002959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.014676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1090/2184] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:28.018711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.030684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62439d22-5d62-4915-9623-9f021fe49b73 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.035544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.036280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.036630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.037056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.038128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.039512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.051127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1091/2185] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:28.060479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.069578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d9ceb-cde9-4138-a186-5e8eda11ce57 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.074437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.076251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.076538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.076817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] PATH_INFO: `/v3/projects/2b1535b0dc5f4261aa72acf137008bc4/users/6db2a0c02bc344b08e128862e7f1a3bd/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.093127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1535b0dc5f4261aa72acf137008bc4, user_id=6db2a0c02bc344b08e128862e7f1a3bd, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.096062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691d9bd-5ba5-43ea-9e11-0fe27b48e5ed admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.153569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18271dfd0e142f29d1a2d8b6765bac9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:28.154404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18271dfd0e142f29d1a2d8b6765bac9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:28.167294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18271dfd0e142f29d1a2d8b6765bac9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:28.177106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1092/2186] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:28 2022] PUT /identity/v3/projects/2b1535b0dc5f4261aa72acf137008bc4/users/6db2a0c02bc344b08e128862e7f1a3bd/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:28.187367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.187657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.187938 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.216794 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] MFA Rules not processed for user `6db2a0c02bc344b08e128862e7f1a3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:28.218090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:28.285154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18271dfd0e142f29d1a2d8b6765bac9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:28.285736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18271dfd0e142f29d1a2d8b6765bac9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:28.288393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1093/2187] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:28.292912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.304540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1095/2188] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:27 2022] DELETE /identity/v3/users/a18271dfd0e142f29d1a2d8b6765bac9 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:28.360725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c4e84-360c-4f33-82f9-389fd7a3ae28 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.417757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.418988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.419352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.419625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.420370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.422435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.537994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1094/2189] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:28 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:28.541854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.543263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:28.556555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d334ce-ec29-4731-aab5-ca72144109a6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.630727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.630727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.630727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.630727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.631292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.634624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.783430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1096/2190] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:28 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:28.787947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.800452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77b947-2e5e-4ca4-aaf6-7b11f9a2dd5e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.807600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:28.810529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.819704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.819704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.819704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.819704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.819704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.827437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1095/2191] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:28.831291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.845222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320e516-c098-424a-8f1f-796029f9005b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.850063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.850966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.851518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.851975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.852893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.854960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.857364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.864237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:28.869988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1097/2192] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:28.874952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:28.882709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:28.887485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f94363-8e11-4438-aa28-37eccefd2f22 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.888668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc33186-e179-4c91-b9e6-855bc2277c67 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:28.897120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.898395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.898941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.899167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] PATH_INFO: `/v3/projects/9775fd30c6324719b2f9e959a4ca9b03/users/57bbe90517f240f6a5da177cb151c70e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.902629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:28.903893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:28.904861 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:28.905133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] PATH_INFO: `/v3/projects/155fec5f51da448b9ace2bbd1ac10897` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:28.906887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=155fec5f51da448b9ace2bbd1ac10897)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.909054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:28.919887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9775fd30c6324719b2f9e959a4ca9b03, user_id=57bbe90517f240f6a5da177cb151c70e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:28.931189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71f90b-0181-4ad7-b284-2f62275d91f1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.102943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1098/2193] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:28 2022] PUT /identity/v3/projects/9775fd30c6324719b2f9e959a4ca9b03/users/57bbe90517f240f6a5da177cb151c70e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:29.104502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056bb65-3523-454a-8bc1-e671c82a61fd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.104955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056bb65-3523-454a-8bc1-e671c82a61fd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.105240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056bb65-3523-454a-8bc1-e671c82a61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.112693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '155fec5f51da448b9ace2bbd1ac10897', 'request_id': 'req-b1578284-e0af-45fc-bd8c-63f03a499f64'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:29.127292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '155fec5f51da448b9ace2bbd1ac10897', 'request_id': 'req-b1578284-e0af-45fc-bd8c-63f03a499f64'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:29.132955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3056bb65-3523-454a-8bc1-e671c82a61fd None None] MFA Rules not processed for user `2fe22b57fdec43aba874cc1589e84e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:29.134111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '155fec5f51da448b9ace2bbd1ac10897', 'request_id': 'req-b1578284-e0af-45fc-bd8c-63f03a499f64'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:29.134571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3056bb65-3523-454a-8bc1-e671c82a61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:29.191530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1099/2194] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:29.192813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.193103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.193416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.221471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] MFA Rules not processed for user `57bbe90517f240f6a5da177cb151c70e`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:29.222677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:29.234447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] The token cache is being invalidate because project 155fec5f51da448b9ace2bbd1ac10897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:29.240283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:29.240283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b1578284-e0af-45fc-bd8c-63f03a499f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:29.240283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1096/2195] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:28 2022] DELETE /identity/v3/projects/155fec5f51da448b9ace2bbd1ac10897 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:29.243434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b643df-c9c2-4ccb-b0fe-475d365aa722 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.244243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b643df-c9c2-4ccb-b0fe-475d365aa722 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.244243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b643df-c9c2-4ccb-b0fe-475d365aa722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.265002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-50b643df-c9c2-4ccb-b0fe-475d365aa722 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:29.266307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-50b643df-c9c2-4ccb-b0fe-475d365aa722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:29.298876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1100/2196] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:29.303948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.305356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:29.334115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1097/2197] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:29.343159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.343616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.343901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.390352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:29.391623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:29.392550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93c460-7383-4ffa-9559-2b6c00514702 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.397589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.398255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.398543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.399323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.399705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.401690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.409237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1098/2198] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:29.415562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.426167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ac328-f408-4107-b089-8f7cffad52ca None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.432486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.433190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.434045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.434341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.435072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:29.435575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.437936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.453299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1099/2199] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:29.454967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.465603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b068cf-c6e2-4169-91ab-62471f007279 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.470475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.471125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.471636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.477741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.477741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.477741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.504450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1101/2200] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:29.508038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.574964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532a980-6a95-4941-9dad-bfecb7770068 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.580007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.580756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.581040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.581396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.582104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.588653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.613511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1100/2201] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/projects => generated 391 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:29.616072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.685427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1102/2202] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:29.690529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.704758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843944bf-0fd8-4069-a151-e18e49151cb9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.729802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d5eb2-eef3-4983-a7e6-fa662ea4d89c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.736296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.737110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.745735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.745735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.745735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.745735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.790148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.790897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.792240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.792240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.792536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.794344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.810461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1103/2203] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:29.814365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.825368 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdaa658-17a7-43c2-8e83-08baa7d1c3df admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.831006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.831962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.832803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.833090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] PATH_INFO: `/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3/users/e609718de6004ce7ac6698cc34df45b1/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.851754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1101/2204] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:29 2022] POST /identity/v3/users => generated 296 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:29.857688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.861164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf3a35543214215b0c561d4a2b3f5e3, user_id=e609718de6004ce7ac6698cc34df45b1, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.864872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.870743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab6075-e656-4246-8a87-e33aee45944e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.876424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.877106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.877422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.880888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.880888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.880888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.895674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1102/2205] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:29.896995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.909083 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d697a6-eeab-4996-990b-05c90354fb3d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:29.914208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:29.914932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:29.915224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:29.915526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:29.916234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:29.918180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:29.944718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1103/2206] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:29.952493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.970642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1104/2207] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:29 2022] PUT /identity/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3/users/e609718de6004ce7ac6698cc34df45b1/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:29.975068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:29.980414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686d224-06c3-4337-8207-b53288468e8d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.083294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30b89b-9667-45eb-befa-92f796c5c110 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.095333 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.096114 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.096408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.096689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.097467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.099154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.102236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.103517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.104102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.104628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] PATH_INFO: `/v3/projects/7d220a7317ca4eaba309e54fd6887997/users/7c1793495a3d41499ab9b02a922ed162/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.118158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1105/2208] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:30.120889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.130326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d220a7317ca4eaba309e54fd6887997, user_id=7c1793495a3d41499ab9b02a922ed162, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.133573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a6833b-9f02-4e18-af92-ea27bde68047 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.135883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f573f3-6130-422f-a4e9-a5acde570163 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.143807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.144771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.146755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.146755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] PATH_INFO: `/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3/users/e609718de6004ce7ac6698cc34df45b1/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.151930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf3a35543214215b0c561d4a2b3f5e3, user_id=e609718de6004ce7ac6698cc34df45b1, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.154939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd6be5-dc0d-4559-85cf-17d1f99da5f3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.166698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1106/2209] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:30 2022] PUT /identity/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3/users/e609718de6004ce7ac6698cc34df45b1/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:30.178233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.178233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.178233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.205369 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] MFA Rules not processed for user `e609718de6004ce7ac6698cc34df45b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:30.206754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:30.242890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1104/2210] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:29 2022] PUT /identity/v3/projects/7d220a7317ca4eaba309e54fd6887997/users/7c1793495a3d41499ab9b02a922ed162/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:30.259306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.259854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.260142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.304310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1107/2211] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:30.304994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] MFA Rules not processed for user `7c1793495a3d41499ab9b02a922ed162`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:30.306592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:30.354428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.354428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:30.392363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1105/2212] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:30.396944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.411686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f1fd-488a-487a-bf97-7b31b910b4ef None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.464761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.466325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.466666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.467012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.468932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:30.470327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4d143-616f-4f71-996a-604168f0b556 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.475828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.476881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.477013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.477237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.478033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.482633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.561677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.563084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.572793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1108/2213] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:30.611014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1106/2214] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:30 2022] POST /identity/v3/projects => generated 391 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:30.611861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.624743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c1a28-4d59-4e4f-83d6-d267d96914d7 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.694880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.695652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.696012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.696730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.697702 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.700033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.822608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1109/2215] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:30 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:30.829033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.839595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc52795-58d1-421f-823e-90bd8148cd27 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.845159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.849335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.849335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.849335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.849335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.849335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.860224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1107/2216] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:30.864367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:30.886885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d482d93-8aa8-42ba-8f12-a12de2f46c9e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:30.892030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:30.893736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:30.893736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:30.893736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] PATH_INFO: `/v3/projects/5360d1989cf048f4babd1c625191f686/users/fe3f473743a541d596c5f6d827a88ba5/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:30.911203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5360d1989cf048f4babd1c625191f686, user_id=fe3f473743a541d596c5f6d827a88ba5, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:30.913940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:30.977025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:31.047690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:31.053529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1110/2217] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:30 2022] PUT /identity/v3/projects/5360d1989cf048f4babd1c625191f686/users/fe3f473743a541d596c5f6d827a88ba5/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:31.057607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:31.073013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3c176-9757-4cd4-9627-822f2f66851e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:31.133081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:31.134445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.134445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.134445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.135081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:31.136730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090d58e-40d2-4a45-9e53-55fdf67c6cfc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:31.147111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1108/2218] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:31.151328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:31.162968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d442a-19a0-490d-868d-a4e467cefd07 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:31.167648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:31.169035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.169366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.169653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] PATH_INFO: `/v3/projects/5360d1989cf048f4babd1c625191f686/users/fe3f473743a541d596c5f6d827a88ba5/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.171651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5360d1989cf048f4babd1c625191f686, user_id=fe3f473743a541d596c5f6d827a88ba5, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:31.174334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:31.186358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1111/2219] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:31 2022] PUT /identity/v3/projects/5360d1989cf048f4babd1c625191f686/users/fe3f473743a541d596c5f6d827a88ba5/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:31.196800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.197112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.197427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.230168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] MFA Rules not processed for user `fe3f473743a541d596c5f6d827a88ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:31.232219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:31.317288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1109/2220] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:31.360461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:31.362203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:31.422983 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f1bf-ccc3-4188-8d42-422c97a5b57b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:31.426655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:31.427300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.427585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.427866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.437437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:31.439600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:31.450999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1112/2221] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:31.555522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:31.567398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffc796-7f8a-42a2-81f0-808cc812054b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:31.571030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:31.571688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.571961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.572230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.633376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:31.634832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:31.644717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1110/2222] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:31.890798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:31.899498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba551c8-14c4-418a-a6df-b74991ebc964 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:31.903536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:31.904945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:31.909081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:31.909081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:31.909081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:31.975700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:31.977226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:31.988807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1113/2223] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:33.110397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:33.199418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:33.763025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:33.772217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7622a4f-e281-4b23-8357-8343f0cb66a5 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:33.776199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:33.776848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:33.777134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:33.777475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:33.845947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:33.847469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb30ca8-b4bf-4e98-92ed-efb41d16eb02 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:33.859318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1111/2224] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:33.860577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:33.862309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:33.935763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2b34d-4a28-4289-84b8-0abae7ce757a service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:33.944107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:33.945115 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:33.945541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:33.945889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] PATH_INFO: `/v3/users/065afb491f5d409fa928f3cbc24f75e4` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:33.947228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065afb491f5d409fa928f3cbc24f75e4)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:33.949392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:34.265160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065afb491f5d409fa928f3cbc24f75e4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:34.266019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065afb491f5d409fa928f3cbc24f75e4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:34.278469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065afb491f5d409fa928f3cbc24f75e4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:34.391568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065afb491f5d409fa928f3cbc24f75e4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:34.392394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065afb491f5d409fa928f3cbc24f75e4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:34.408161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1114/2225] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:33 2022] DELETE /identity/v3/users/065afb491f5d409fa928f3cbc24f75e4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:34.412380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:34.412837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:34.412940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:34.435916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:34.437313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:34.510437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1112/2226] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:34.524436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:34.526457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:34.619069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd1c18a-03ac-4994-8462-7986bf6393b8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:34.625143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:34.625769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:34.626056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:34.626721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:34.651095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:34.651095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:34.657775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1115/2227] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:34.792905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:35.039248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:35.282203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:35.283966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:35.319396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ec85e-ea0f-45e7-a08e-641a62a7b30c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:35.329037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:35.329953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:35.330261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:35.330512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] PATH_INFO: `/v3/projects/238fbf5ebff5473d87cf32c35857b958` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:35.334383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=238fbf5ebff5473d87cf32c35857b958)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:35.334383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:35.480125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '238fbf5ebff5473d87cf32c35857b958', 'request_id': 'req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.490217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '238fbf5ebff5473d87cf32c35857b958', 'request_id': 'req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.497679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '238fbf5ebff5473d87cf32c35857b958', 'request_id': 'req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.563479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] The token cache is being invalidate because project 238fbf5ebff5473d87cf32c35857b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:35.563864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.564632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.569503 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1113/2228] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:35 2022] DELETE /identity/v3/projects/238fbf5ebff5473d87cf32c35857b958 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:35.570425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:35.581356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ccbad-02fd-45ee-b937-1701c0d34ed0 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:35.645767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:35.646724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:35.647010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:35.647901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] PATH_INFO: `/v3/users/97c684aa2b9243228619561771654ea9` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:35.649134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c684aa2b9243228619561771654ea9)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:35.651094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:35.950111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c684aa2b9243228619561771654ea9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.951299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c684aa2b9243228619561771654ea9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:35.973322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c684aa2b9243228619561771654ea9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:36.048844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c684aa2b9243228619561771654ea9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:36.059541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c684aa2b9243228619561771654ea9'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:36.079249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1116/2229] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:35 2022] DELETE /identity/v3/users/97c684aa2b9243228619561771654ea9 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:36.143289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:36.145105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:36.158470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:36.222216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1301-585f-4ef3-8198-a1bf9be21cc1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:36.272284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:36.272933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:36.273745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:36.274026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:36.275799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:36.362458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:36.364041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79389e6-5fe8-483b-bd57-df10831e8a0c service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:36.375142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1114/2230] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:36.732129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:36.733818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:36.814146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c8cdf-2b04-430e-ab03-8e1d57445e56 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:36.819578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:36.820452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:36.820790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:36.821087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] PATH_INFO: `/v3/projects/20504334e43e4ba78110d0da09f19e3b` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:36.824342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=20504334e43e4ba78110d0da09f19e3b)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:36.825855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:36.983139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20504334e43e4ba78110d0da09f19e3b', 'request_id': 'req-e462a021-a6ab-4112-9527-4ece1edde8fb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:36.989415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20504334e43e4ba78110d0da09f19e3b', 'request_id': 'req-e462a021-a6ab-4112-9527-4ece1edde8fb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:36.994895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20504334e43e4ba78110d0da09f19e3b', 'request_id': 'req-e462a021-a6ab-4112-9527-4ece1edde8fb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:37.004748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:37.295293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] The token cache is being invalidate because project 20504334e43e4ba78110d0da09f19e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:37.295293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:37.295293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e462a021-a6ab-4112-9527-4ece1edde8fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:37.295293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1117/2231] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:36 2022] DELETE /identity/v3/projects/20504334e43e4ba78110d0da09f19e3b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:37.298056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.298056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.298056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.314372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:37.315715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:37.378647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1115/2232] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:37.386468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.386780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.387169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.407015 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:37.408409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:37.416891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1118/2233] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:37.421675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.431327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b54a95-9d07-4341-bda3-182fae741787 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.436913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.437617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.437906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.438219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.438954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:37.439266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.440891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.456377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1116/2234] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:37.463551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.475709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe9377-a8ce-407e-9d0b-2fc805a09046 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.481069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.481907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.490688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.490688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.490688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.490688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.594348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1119/2235] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:37 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:37.599713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.609096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bf09e-ec30-4f29-b387-a07bff0bccd9 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.667048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.667720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.668039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.668373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.669071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.671053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.785718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1117/2236] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:37 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:37.787730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.797750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5af28a-2b28-441d-ba1c-0757b6a75983 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.802612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.803325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.803608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.803885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.804606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.806231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.819706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1120/2237] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:37.823977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.834810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8647cf-ed3d-4088-ba1c-9800117bfc20 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.840456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.841514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.841972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.842258 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.843185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.844799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92274c44-c274-4c86-8884-60c64e226866 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.856878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1118/2238] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:37.861208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:37.871041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b9d9c-af09-4f54-95ec-457d44d5eb6c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:37.876665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:37.888875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:37.888875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:37.888875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] PATH_INFO: `/v3/projects/6bc9c7a144fe435fabb05bbf34930624/users/aeefaa3ae8b949b09a94d4d9598bea34/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:37.892756 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc9c7a144fe435fabb05bbf34930624, user_id=aeefaa3ae8b949b09a94d4d9598bea34, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:37.895417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:37.994524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1121/2239] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:37 2022] PUT /identity/v3/projects/6bc9c7a144fe435fabb05bbf34930624/users/aeefaa3ae8b949b09a94d4d9598bea34/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:38.006036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.006388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.006673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.034483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] MFA Rules not processed for user `aeefaa3ae8b949b09a94d4d9598bea34`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:38.035688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:38.100329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1119/2240] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:38.105309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.167047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9792c05-5c06-411a-afe8-f3d4c9ef117a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.172310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.173004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.173319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.173621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.174346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.176411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.263770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1122/2241] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:38 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:38.268174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.279316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db8abd-02d8-459e-82a8-13b920f78b27 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.338968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.340216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.340528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.340833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.341756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.343730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.468953 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1120/2242] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:38 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:38.472757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.485328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53910156-c98a-4d89-a6fa-d12829fd2fbb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.498287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.499405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.500195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:38.500426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.500867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.502185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.503864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.505383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.531764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41da8-6345-4d46-b9b1-27cdb7a9f1b4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.542665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1123/2243] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:38.544953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.546087 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.549811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:38.550342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.551442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.551971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] PATH_INFO: `/v3/users/7c1793495a3d41499ab9b02a922ed162` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.553465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1793495a3d41499ab9b02a922ed162)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.556408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.566691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d7868-0679-4b0e-9e49-1397bf1d1849 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.577955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.578860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.579240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.579403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] PATH_INFO: `/v3/projects/8286d617e3894ef699727c6d99fcda78/users/34667ad893cf4ad9bdc3e94b83922749/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.599232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8286d617e3894ef699727c6d99fcda78, user_id=34667ad893cf4ad9bdc3e94b83922749, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.602030 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.674192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1124/2244] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:38 2022] PUT /identity/v3/projects/8286d617e3894ef699727c6d99fcda78/users/34667ad893cf4ad9bdc3e94b83922749/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:38.678062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.708414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:38.751528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f67fa-deae-4b90-ad29-819f5617f0e4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.756399 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.757927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.757927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.757927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.758351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.759946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.770676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1125/2245] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:38.775680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:38.785953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d31c4e-2508-4323-af7b-bbd7aacfe711 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:38.790519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:38.791409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.791695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.791970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] PATH_INFO: `/v3/projects/8286d617e3894ef699727c6d99fcda78/users/34667ad893cf4ad9bdc3e94b83922749/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.794268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8286d617e3894ef699727c6d99fcda78, user_id=34667ad893cf4ad9bdc3e94b83922749, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:38.796869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b90eb6-1dfa-4b58-be59-7b5b08c854c3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:38.807303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1126/2246] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:38 2022] PUT /identity/v3/projects/8286d617e3894ef699727c6d99fcda78/users/34667ad893cf4ad9bdc3e94b83922749/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:38.817220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.817560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.817843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.823865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1793495a3d41499ab9b02a922ed162'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:38.841908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1793495a3d41499ab9b02a922ed162'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:38.847307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] MFA Rules not processed for user `34667ad893cf4ad9bdc3e94b83922749`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:38.848628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:38.903112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1793495a3d41499ab9b02a922ed162'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:38.903859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1793495a3d41499ab9b02a922ed162'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:38.904596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8e351033-c97a-4f22-9359-ade5f73f9479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1793495a3d41499ab9b02a922ed162'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:38.921951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1121/2247] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:38 2022] DELETE /identity/v3/users/7c1793495a3d41499ab9b02a922ed162 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:38.923655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1127/2248] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:38.926437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:38.927180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:38.927625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:38.948627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:38.951133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:39.014001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1122/2249] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:39.023825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:39.025242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:39.082745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec5a99-7cec-4acd-83a4-a2ef677ad2a8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:39.141105 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:39.141699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:39.142013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:39.142259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:39.151309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:39.153568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:39.162788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1128/2250] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:39.491473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:39.493933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:39.495470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:39.496959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:39.587212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78cf3e-74d4-40f9-a005-a91d314ad54b service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:39.592276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:39.592919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:39.593203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:39.593515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:39.626332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f5e778-edcd-4fd7-ab38-a8f7bf967549 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:39.659222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:39.660256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:39.660706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:39.661907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] PATH_INFO: `/v3/users/87442723deb84646bdfcec0e26e1ff85` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:39.666656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87442723deb84646bdfcec0e26e1ff85)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:39.671372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:39.741294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:39.745120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:39.772082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1129/2251] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:39.773160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:39.775106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:39.792861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6badb3-caa7-4d76-ad99-f68430829a5f service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:39.801516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:39.803842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:39.804137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:39.804423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] PATH_INFO: `/v3/projects/7d220a7317ca4eaba309e54fd6887997` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:39.805945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d220a7317ca4eaba309e54fd6887997)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:39.808431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:39.833436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:39.975273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87442723deb84646bdfcec0e26e1ff85'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:39.998488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d220a7317ca4eaba309e54fd6887997', 'request_id': 'req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.000555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87442723deb84646bdfcec0e26e1ff85'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.010538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d220a7317ca4eaba309e54fd6887997', 'request_id': 'req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.024610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d220a7317ca4eaba309e54fd6887997', 'request_id': 'req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.165302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87442723deb84646bdfcec0e26e1ff85'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.165790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87442723deb84646bdfcec0e26e1ff85'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.166581 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-c60dc438-4d02-4817-8381-4101569a6f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87442723deb84646bdfcec0e26e1ff85'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.184656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1123/2252] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:39 2022] DELETE /identity/v3/users/87442723deb84646bdfcec0e26e1ff85 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:40.188707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:40.188924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:40.189199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:40.220711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:40.221992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:40.282602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1124/2253] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:40.292438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:40.293908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:40.308767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] The token cache is being invalidate because project 7d220a7317ca4eaba309e54fd6887997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:40.308767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.308767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.308767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1130/2254] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:39 2022] DELETE /identity/v3/projects/7d220a7317ca4eaba309e54fd6887997 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:40.309986 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:40.311577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:40.384384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccff4e8-533a-4c7d-ab92-0390a572e567 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:40.397553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:40.398327 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:40.398975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:40.399185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:40.405555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:40.412055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac209a04-f4e4-4dbf-8bda-0f9209fcc0ed admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:40.419251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:40.421222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:40.430897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:40.433157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1125/2255] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:40.434327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:40.434620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:40.434906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] PATH_INFO: `/v3/users/fe3f473743a541d596c5f6d827a88ba5` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:40.436299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe3f473743a541d596c5f6d827a88ba5)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:40.439475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:40.628578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe3f473743a541d596c5f6d827a88ba5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.629449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe3f473743a541d596c5f6d827a88ba5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.646547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe3f473743a541d596c5f6d827a88ba5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.719285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe3f473743a541d596c5f6d827a88ba5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.720100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe3f473743a541d596c5f6d827a88ba5'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:40.734054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1131/2256] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:40 2022] DELETE /identity/v3/users/fe3f473743a541d596c5f6d827a88ba5 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:40.811975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:40.869526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:40.883173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:40.913403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a39920-f0bc-4711-a583-c091fc3d0731 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:41.012604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:41.013899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.015815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.016456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] PATH_INFO: `/v3/projects/29ce14baaafe4449bf9ee4e3002f2648` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.018600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29ce14baaafe4449bf9ee4e3002f2648)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:41.021425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:41.201243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29ce14baaafe4449bf9ee4e3002f2648', 'request_id': 'req-98fca38f-ecf8-4b82-8988-1d8a17b516a3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.208007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29ce14baaafe4449bf9ee4e3002f2648', 'request_id': 'req-98fca38f-ecf8-4b82-8988-1d8a17b516a3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.216249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29ce14baaafe4449bf9ee4e3002f2648', 'request_id': 'req-98fca38f-ecf8-4b82-8988-1d8a17b516a3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.268202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:41.331564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] The token cache is being invalidate because project 29ce14baaafe4449bf9ee4e3002f2648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:41.331970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.332686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.334356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1126/2257] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:40 2022] DELETE /identity/v3/projects/29ce14baaafe4449bf9ee4e3002f2648 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:41.338713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:41.340771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.353652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98e812-5bb5-457d-9cde-b2b83a48171b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:41.414434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:41.415310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.415593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.415866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] PATH_INFO: `/v3/users/1d36436720164ee6afa0988387df260b` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.417055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d36436720164ee6afa0988387df260b)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:41.420281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:41.449037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:41.450981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.463903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fca38f-ecf8-4b82-8988-1d8a17b516a3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:41.469217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:41.470137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.470420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.470691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] PATH_INFO: `/v3/users/aeefaa3ae8b949b09a94d4d9598bea34` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.471882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeefaa3ae8b949b09a94d4d9598bea34)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:41.473832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:41.675283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d36436720164ee6afa0988387df260b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.675938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d36436720164ee6afa0988387df260b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.688217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d36436720164ee6afa0988387df260b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.711787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeefaa3ae8b949b09a94d4d9598bea34'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.724567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeefaa3ae8b949b09a94d4d9598bea34'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.769283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d36436720164ee6afa0988387df260b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.770001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d36436720164ee6afa0988387df260b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.784042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1132/2258] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:41 2022] DELETE /identity/v3/users/1d36436720164ee6afa0988387df260b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:41.784859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:41.786193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.805946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:41.856462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeefaa3ae8b949b09a94d4d9598bea34'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.857603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeefaa3ae8b949b09a94d4d9598bea34'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.857827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ec609003-632e-4e7d-b4c9-dd46552c714f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeefaa3ae8b949b09a94d4d9598bea34'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:41.872619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1127/2259] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:41 2022] DELETE /identity/v3/users/aeefaa3ae8b949b09a94d4d9598bea34 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:41.874716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430f07-f803-4ca0-92e5-00382313414e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:41.877206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.877528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.877907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.904449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:41.906219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:41.960365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:41.961348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:41.961681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:41.961959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] PATH_INFO: `/v3/projects/5360d1989cf048f4babd1c625191f686` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:41.963614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5360d1989cf048f4babd1c625191f686)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:41.966328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.019813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1128/2260] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:42.029958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.032147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.100455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5360d1989cf048f4babd1c625191f686', 'request_id': 'req-e51c2348-9e58-4d97-9f00-5df8e30c3461'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.113313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5360d1989cf048f4babd1c625191f686', 'request_id': 'req-e51c2348-9e58-4d97-9f00-5df8e30c3461'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.122760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5360d1989cf048f4babd1c625191f686', 'request_id': 'req-e51c2348-9e58-4d97-9f00-5df8e30c3461'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.240739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] The token cache is being invalidate because project 5360d1989cf048f4babd1c625191f686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:42.240855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.242058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.244467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1133/2261] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:41 2022] DELETE /identity/v3/projects/5360d1989cf048f4babd1c625191f686 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:42.250994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.262811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.262899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b960a-baf0-480c-9ac4-8d8bea80151e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.369804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.370467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.370748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.371124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.375029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.379483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c2348-9e58-4d97-9f00-5df8e30c3461 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.392922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.394767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.395588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.395588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] PATH_INFO: `/v3/users/6db2a0c02bc344b08e128862e7f1a3bd` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.395827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.396918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db2a0c02bc344b08e128862e7f1a3bd)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.398111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbca0e1-b89c-48d5-bdef-47f6a5fd1be7 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.400402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.412198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1129/2262] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:42.413823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffc-22fc-46e6-975d-5928333fc297 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.414112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffc-22fc-46e6-975d-5928333fc297 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.414884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe468ffc-22fc-46e6-975d-5928333fc297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.443079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fe468ffc-22fc-46e6-975d-5928333fc297 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:42.448819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fe468ffc-22fc-46e6-975d-5928333fc297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.460787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1130/2263] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:42.470686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.471061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.471441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.492047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:42.493324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.516582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1131/2264] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:42.518141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.525545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.537151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7fe82-5a97-4f5d-8157-e3f0cdd7a0f3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.544894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.544894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.544894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.544894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] PATH_INFO: `/v3/projects/44630288d50a466fabfe46350d33625f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.545419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44630288d50a466fabfe46350d33625f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.547717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.603300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db2a0c02bc344b08e128862e7f1a3bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.603959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db2a0c02bc344b08e128862e7f1a3bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.616611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db2a0c02bc344b08e128862e7f1a3bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.681733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44630288d50a466fabfe46350d33625f', 'request_id': 'req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.688151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44630288d50a466fabfe46350d33625f', 'request_id': 'req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.691054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db2a0c02bc344b08e128862e7f1a3bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.691770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db2a0c02bc344b08e128862e7f1a3bd'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.694749 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44630288d50a466fabfe46350d33625f', 'request_id': 'req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.706365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1134/2265] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:42 2022] DELETE /identity/v3/users/6db2a0c02bc344b08e128862e7f1a3bd => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:42.710207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.711637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.776405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:42.786968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced2cb6-692b-4472-b573-ff51c37db8bd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.797612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.798302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.798591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.798897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.799646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:42.799961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.801610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0a4bb-a4ff-4e12-b38c-fa9cec11f943 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.813532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] The token cache is being invalidate because project 44630288d50a466fabfe46350d33625f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:42.814135 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.814719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:42.816135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1135/2266] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:42.817073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1132/2267] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:42 2022] DELETE /identity/v3/projects/44630288d50a466fabfe46350d33625f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:42.820842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7de7a-d4bc-46da-9712-d7cc775de263 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.821173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7de7a-d4bc-46da-9712-d7cc775de263 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.821367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e7de7a-d4bc-46da-9712-d7cc775de263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.822300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.823880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.839905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-43e7de7a-d4bc-46da-9712-d7cc775de263 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:42.841113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-43e7de7a-d4bc-46da-9712-d7cc775de263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.850765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1136/2268] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:42.852101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.852389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.852665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.876141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:42.877425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.885658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1137/2269] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:42.886439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:42.888374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:42.908499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e8136a-06f8-4eae-b1a8-e7a297eb8716 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.913355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.914044 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.914460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.914747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.915435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.917406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.947505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861bba7-5ae3-403e-b5a5-1eedbc0aeb6f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:42.952366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:42.953191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.953566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.953792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:42.966063 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:42.967513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147021c-766d-4596-8de1-d72da1c9027a service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:42.979283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1138/2270] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:42.981639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:42.981639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:42.981924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.005823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:43.007046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.030007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1139/2271] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:43.030007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.038232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.045019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae135-014a-423a-ae72-a5041ef59aab None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.050899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.051772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.052053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.052328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] PATH_INFO: `/v3/projects/6bc9c7a144fe435fabb05bbf34930624` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.054123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc9c7a144fe435fabb05bbf34930624)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.056462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.068781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1133/2272] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:42 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:43.069642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.132708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61c11-5947-4075-abc6-123685c4edeb admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.137633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.138321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.138642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.138931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.139687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:43.140025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.141758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.153004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1134/2273] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:43.153822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.163015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c76e-2341-4474-aa72-cb8dacbb06ad admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.167684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.168848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.169128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.169437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.170111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.171974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.226231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc9c7a144fe435fabb05bbf34930624', 'request_id': 'req-44565203-80c3-4760-af21-b273671078b1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.238724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc9c7a144fe435fabb05bbf34930624', 'request_id': 'req-44565203-80c3-4760-af21-b273671078b1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.257606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc9c7a144fe435fabb05bbf34930624', 'request_id': 'req-44565203-80c3-4760-af21-b273671078b1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.295407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1135/2274] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:43 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:43.295407 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.304324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d2945-9c1e-4e6e-b92f-e1c8e42ba45b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.367647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.372120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.372120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.372120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.372120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.372923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.409998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] The token cache is being invalidate because project 6bc9c7a144fe435fabb05bbf34930624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:43.410271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.411097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.412830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1140/2275] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:43 2022] DELETE /identity/v3/projects/6bc9c7a144fe435fabb05bbf34930624 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:43.414055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.415762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.430180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44565203-80c3-4760-af21-b273671078b1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.435937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.441183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.441183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.441183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.441183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.441183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.453491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1141/2276] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:43.453491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.453491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.466481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5acea3-85ab-4ca3-9dca-889f2f728c94 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.471414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.472270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.472554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.472830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] PATH_INFO: `/v3/users/34667ad893cf4ad9bdc3e94b83922749` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.474043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34667ad893cf4ad9bdc3e94b83922749)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.475950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.526590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1136/2277] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:43 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:43.528144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.602212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ff6f7-2bac-4119-9fc4-6fb6b61c1514 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.607641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.608314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.608600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.608877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.609641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.611360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.621595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1137/2278] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:43.622752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.624296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.643527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a344f-433a-4128-9bff-24562053166f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.649233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.650523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.650812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.651090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] PATH_INFO: `/v3/projects/2b1535b0dc5f4261aa72acf137008bc4` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.653317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1535b0dc5f4261aa72acf137008bc4)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.654966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.686768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34667ad893cf4ad9bdc3e94b83922749'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.687524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34667ad893cf4ad9bdc3e94b83922749'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.704069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34667ad893cf4ad9bdc3e94b83922749'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.753091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34667ad893cf4ad9bdc3e94b83922749'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.753727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34667ad893cf4ad9bdc3e94b83922749'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.753838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1535b0dc5f4261aa72acf137008bc4', 'request_id': 'req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.760865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1535b0dc5f4261aa72acf137008bc4', 'request_id': 'req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.766306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1142/2279] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:43 2022] DELETE /identity/v3/users/34667ad893cf4ad9bdc3e94b83922749 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:43.767154 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.768466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.769626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1535b0dc5f4261aa72acf137008bc4', 'request_id': 'req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.836043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392d045-a175-47ea-8576-af51c9fe6d26 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.843530 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.844592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.844892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.845184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] The token cache is being invalidate because project 2b1535b0dc5f4261aa72acf137008bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:43.845449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.845570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.846170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:43.846276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.848020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1138/2280] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:43 2022] DELETE /identity/v3/projects/2b1535b0dc5f4261aa72acf137008bc4 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:43.848679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.850270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.851585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.919799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e21e5b-d36d-4fdd-b23c-f28f5dce4efa admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.924562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.925509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.925798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.926076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] PATH_INFO: `/v3/projects/2c3bf6cc9feb4b69bb341eb7d8c08d28/users/b2593727b2884727812a6e8a8474c148/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.938265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1143/2281] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:43 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:43.939818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:43.942340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c3bf6cc9feb4b69bb341eb7d8c08d28, user_id=b2593727b2884727812a6e8a8474c148, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.942657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:43.945043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:43.979963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a14a66-5cd2-4bc0-9eb3-06e2dc6bd69a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:43.986361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:43.987289 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:43.988178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:43.988178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] PATH_INFO: `/v3/users/57bbe90517f240f6a5da177cb151c70e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:43.989111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57bbe90517f240f6a5da177cb151c70e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:43.992828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.067587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1139/2282] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:43 2022] PUT /identity/v3/projects/2c3bf6cc9feb4b69bb341eb7d8c08d28/users/b2593727b2884727812a6e8a8474c148/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:44.068463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.078547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.153190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8edd5-b4e8-4783-988f-a87c62c68b9a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:44.158663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:44.159334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.159628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.159902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.161459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:44.165422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13111de8-7d6e-4502-8db7-2fef86230f9a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.173249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1140/2283] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:44.174641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.174925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.175209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.202932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] MFA Rules not processed for user `b2593727b2884727812a6e8a8474c148`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:44.204228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.269525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1141/2284] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:44.270375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.283537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db0e047-0505-4ae8-bbb2-cc7cc7bb5ca0 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:44.288475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:44.289143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.289455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.289735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.290477 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:44.292071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.302985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1142/2285] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:44.303681 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.314448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.327789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57bbe90517f240f6a5da177cb151c70e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.328988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57bbe90517f240f6a5da177cb151c70e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.332182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:44.333512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad6ed3-a40e-4f21-913c-e9eb3666853d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:44.339801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:44.340994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.341929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.341929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] PATH_INFO: `/v3/projects/8286d617e3894ef699727c6d99fcda78` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.343455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8286d617e3894ef699727c6d99fcda78)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:44.345461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.362190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57bbe90517f240f6a5da177cb151c70e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.448907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57bbe90517f240f6a5da177cb151c70e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.452031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57bbe90517f240f6a5da177cb151c70e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.471920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1144/2286] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:43 2022] DELETE /identity/v3/users/57bbe90517f240f6a5da177cb151c70e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:44.473851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.475255 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.514264 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8286d617e3894ef699727c6d99fcda78', 'request_id': 'req-ea9f0f7b-443f-43d9-af07-54994d1ea944'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.530700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8286d617e3894ef699727c6d99fcda78', 'request_id': 'req-ea9f0f7b-443f-43d9-af07-54994d1ea944'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.538132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8286d617e3894ef699727c6d99fcda78', 'request_id': 'req-ea9f0f7b-443f-43d9-af07-54994d1ea944'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.578393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f3038-6638-4205-ab71-274ef3058b69 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:44.622664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] The token cache is being invalidate because project 8286d617e3894ef699727c6d99fcda78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:44.622951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.623924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:44.627941 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1143/2287] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:44 2022] DELETE /identity/v3/projects/8286d617e3894ef699727c6d99fcda78 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:44.629382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.632782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.666606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:44.667360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.667716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.668764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.669610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:44.671880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0832f-126f-4f37-875d-04d985b8ba18 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.715332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f0f7b-443f-43d9-af07-54994d1ea944 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:44.721814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:44.722716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.722999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.723438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] PATH_INFO: `/v3/projects/404c8689a66f411ab53411e29287ebbf/users/643fcea62b14478c8656abb04782f280/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.740950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=404c8689a66f411ab53411e29287ebbf, user_id=643fcea62b14478c8656abb04782f280, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:44.743811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:44.787546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1145/2288] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:44 2022] POST /identity/v3/projects => generated 377 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:44.790538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8517-2adf-4786-a86d-ab010b1eb746 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.790839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8517-2adf-4786-a86d-ab010b1eb746 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.791119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8517-2adf-4786-a86d-ab010b1eb746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:44.848651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-edff8517-2adf-4786-a86d-ab010b1eb746 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:44.849896 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-edff8517-2adf-4786-a86d-ab010b1eb746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.911578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1144/2289] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:44 2022] PUT /identity/v3/projects/404c8689a66f411ab53411e29287ebbf/users/643fcea62b14478c8656abb04782f280/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:44.912575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:44.917449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:44.967433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1146/2290] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:44.968034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b04c-dae1-449e-b512-2f598dba8050 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:44.976212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b04c-dae1-449e-b512-2f598dba8050 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:44.976628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9b04c-dae1-449e-b512-2f598dba8050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.009246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-17c9b04c-dae1-449e-b512-2f598dba8050 None None] MFA Rules not processed for user `643fcea62b14478c8656abb04782f280`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:45.010612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-17c9b04c-dae1-449e-b512-2f598dba8050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.056643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5dffc-6140-42d2-8a8a-793d35548f6c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.062658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.063339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.063673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.063956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.064650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.066729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.097188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1147/2291] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:45.098737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.099031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.099312 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.117419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:45.118614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.127070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1148/2292] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:45.127845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.137002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be9ee-21a6-4381-a750-a10190150d1a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.141916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.144299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.144299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.144299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.144299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.145680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.180242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1145/2293] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:44 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:45.180242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.189860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b551ef-faa3-429c-90bd-337556c46825 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.194646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.195311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.195653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.195950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.196663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:45.196969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.198963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.218491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1146/2294] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:45.218491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.218491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.230217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b300efa-7eca-4ce9-84ab-3ba201d3ebe3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.235671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.236517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.236801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.237782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] PATH_INFO: `/v3/projects/9775fd30c6324719b2f9e959a4ca9b03` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.238275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9775fd30c6324719b2f9e959a4ca9b03)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.240173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.267720 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1149/2295] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:45 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:45.268855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.331738 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8196cb-72b3-4592-9739-35687b4f8aef admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.336677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.337376 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.337908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.338202 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.338924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.341297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.351971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1150/2296] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:45.352767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.362574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525a03d-9e89-433c-bbc9-f7a0a24841bb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.378625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9775fd30c6324719b2f9e959a4ca9b03', 'request_id': 'req-e173487b-bc29-4723-a799-17236b5c9c5f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:45.387070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9775fd30c6324719b2f9e959a4ca9b03', 'request_id': 'req-e173487b-bc29-4723-a799-17236b5c9c5f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:45.396765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9775fd30c6324719b2f9e959a4ca9b03', 'request_id': 'req-e173487b-bc29-4723-a799-17236b5c9c5f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:45.427559 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.428214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.428498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.428776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.429494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.431415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.482737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] The token cache is being invalidate because project 9775fd30c6324719b2f9e959a4ca9b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:45.483104 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:45.483803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:45.485394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1147/2297] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:45 2022] DELETE /identity/v3/projects/9775fd30c6324719b2f9e959a4ca9b03 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:45.486130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.487409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.501021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173487b-bc29-4723-a799-17236b5c9c5f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.505701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.513733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.514282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.514759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.515696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.518229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.565304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1151/2298] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:45 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:45.565304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.567507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.616915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1148/2299] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:45 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:45.618092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.620022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.633766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debad8e-c936-4ecc-964c-ae931fc18b63 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.634179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dedbe6-2e10-4bfa-b617-fdc3e0fdf11b admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.639850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.640016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.640871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.641188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.641529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.641705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.642147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.642458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.647740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] PATH_INFO: `/v3/users/e609718de6004ce7ac6698cc34df45b1` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.648025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.648111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e609718de6004ce7ac6698cc34df45b1)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.650390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.663547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1152/2300] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:45.664416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.666220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:45.680985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20dcd0-af1d-418c-9214-80a2185c59e8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.686611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.687224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.687507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.688164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.688465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.690587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.789844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1153/2301] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:45 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:45.789844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.802549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abee79-378e-436c-84dc-084e161fe4bf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.807434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.808184 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.809166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.809537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.810341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.812068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:45.831570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1154/2302] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:45.831570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:45.838336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0749c-829d-4a7d-afc9-e7034839dd40 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:45.843957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:45.844923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:45.845314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:45.845607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] PATH_INFO: `/v3/projects/fe9fea42ce8247ddbcec43c52a00a8dd/users/39786d1422634885b5c0dab563104465/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:45.864236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe9fea42ce8247ddbcec43c52a00a8dd, user_id=39786d1422634885b5c0dab563104465, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:45.867189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.077514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1155/2303] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:45 2022] PUT /identity/v3/projects/fe9fea42ce8247ddbcec43c52a00a8dd/users/39786d1422634885b5c0dab563104465/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:46.078515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.079155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e609718de6004ce7ac6698cc34df45b1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:46.093735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e609718de6004ce7ac6698cc34df45b1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:46.141915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57220ebd-485c-4cff-baf6-98d5906b8555 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.150307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.150307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.150307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.150307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.150652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.150652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.161061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1156/2304] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:46.162291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.172470 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27db1ed-2a08-4a38-964b-950ea62e0388 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.177170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.177879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.178165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.178731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.179378 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.181124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f2f86-88a6-42b2-b762-e926a4a19c02 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.192304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1157/2305] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:46.193803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.194101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.194381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.228725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] MFA Rules not processed for user `39786d1422634885b5c0dab563104465`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:46.230129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.250762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e609718de6004ce7ac6698cc34df45b1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:46.251405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e609718de6004ce7ac6698cc34df45b1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:46.252009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e609718de6004ce7ac6698cc34df45b1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:46.267869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1149/2306] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:45 2022] DELETE /identity/v3/users/e609718de6004ce7ac6698cc34df45b1 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:46.273716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.275522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.319146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1158/2307] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:46.332252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.335806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.356545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:46.366666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631aebc-a244-4660-a475-d0bf96c1eb9b None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.385908 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b02aca1-2a0d-438b-b1f4-f52a4da18828 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.391773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.395979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.395979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.395979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.395979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.395979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.410086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1150/2308] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:46 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:46.410086 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.412295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.425916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b70e89-1f9f-4b7e-8647-68dc59ccf190 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.430785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.435609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.435609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.435609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.435609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.435609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.436428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.437382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.437671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.437955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] PATH_INFO: `/v3/projects/6dae5ed3a3154bd6b72dae0102640ba2/users/f83cfc1ea6144743966c3bd83ff4360d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.453677 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dae5ed3a3154bd6b72dae0102640ba2, user_id=f83cfc1ea6144743966c3bd83ff4360d, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.456364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.508003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:46.583101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1159/2309] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:46 2022] PUT /identity/v3/projects/6dae5ed3a3154bd6b72dae0102640ba2/users/f83cfc1ea6144743966c3bd83ff4360d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:46.593546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1151/2310] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:46 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:46.593546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.595219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.691306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28ef3db-086e-4cea-b8b3-246d0e5725a1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.696497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.697744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.698033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.698366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] PATH_INFO: `/v3/projects/b0dc5b50bdec4ef7b17f1dc014356e5d/users/b5da1e9424364ecbb9ec2b7a513e1bc1/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.700360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a864074-7713-4091-95e3-60fb55ef5c02 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.706557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.707242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.707529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.707815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.708510 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.710550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.723186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0dc5b50bdec4ef7b17f1dc014356e5d, user_id=b5da1e9424364ecbb9ec2b7a513e1bc1, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.725915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290a4c8-c043-4a14-a813-6ebdbfd4859e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.857184 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1152/2311] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:46 2022] PUT /identity/v3/projects/b0dc5b50bdec4ef7b17f1dc014356e5d/users/b5da1e9424364ecbb9ec2b7a513e1bc1/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:46.865917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5520b-84bf-4acc-9614-d59fae3d40be None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.866157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5520b-84bf-4acc-9614-d59fae3d40be None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.866446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5520b-84bf-4acc-9614-d59fae3d40be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.887766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1160/2312] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:46 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:46.887938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:46.893746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.899278 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-aca5520b-84bf-4acc-9614-d59fae3d40be None None] MFA Rules not processed for user `f83cfc1ea6144743966c3bd83ff4360d`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:46.900534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-aca5520b-84bf-4acc-9614-d59fae3d40be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:46.906813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f34d8-e48a-45c5-9d75-44f33120dccb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:46.976053 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:46.977025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.977343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.977632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] PATH_INFO: `/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:46.978840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf3a35543214215b0c561d4a2b3f5e3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:46.980677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1153/2313] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:46.981109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:46.982297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:46.982864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:46.989394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.015648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] MFA Rules not processed for user `b5da1e9424364ecbb9ec2b7a513e1bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:47.017413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.091968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1154/2314] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:47.091968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.104819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1845acc-f957-4f4a-8436-cb72eeae9d00 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.112159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.112950 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.113339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.113705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.114507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.116111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.133373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1155/2315] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:47.134226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.144944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7955bac7-fd86-4a0c-ad24-1d7376f418b0 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.150710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.151378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.151826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.152008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.153828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.155888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.182827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf3a35543214215b0c561d4a2b3f5e3', 'request_id': 'req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:47.190956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf3a35543214215b0c561d4a2b3f5e3', 'request_id': 'req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:47.197116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf3a35543214215b0c561d4a2b3f5e3', 'request_id': 'req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:47.328151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] The token cache is being invalidate because project ccf3a35543214215b0c561d4a2b3f5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:47.332083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:47.332792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1156/2316] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:47 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:47.334070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:47.334364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.336425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1161/2317] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:46 2022] DELETE /identity/v3/projects/ccf3a35543214215b0c561d4a2b3f5e3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:47.337016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.338192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.341029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.408374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee9dc4-1526-4788-825e-679234d5e40e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.412222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.412933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.413224 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.413598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.415423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.425384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d53cd9-d7a4-45f8-85cb-ac99de1c5fea admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.482467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.484271 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.493668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1157/2318] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:47.494039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.494531 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.495078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.495438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.495794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] PATH_INFO: `/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3/users/77879cdfb77640ba9a43584ea9e4d47a/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.496175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.510289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ecc3d-9b21-4133-aaaf-2f966c830072 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.512220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd472a8d6c9a4b1fac0d718433b816e3, user_id=77879cdfb77640ba9a43584ea9e4d47a, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.514945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.515479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694def22-3778-4c62-84ff-174339074bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.516150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694def22-3778-4c62-84ff-174339074bee admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.516435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694def22-3778-4c62-84ff-174339074bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.516714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694def22-3778-4c62-84ff-174339074bee admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.517444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694def22-3778-4c62-84ff-174339074bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.519853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694def22-3778-4c62-84ff-174339074bee admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.622885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1158/2319] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:47 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:47.624076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1162/2320] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:47 2022] PUT /identity/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3/users/77879cdfb77640ba9a43584ea9e4d47a/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:47.624204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.624464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.624744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.628345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.646340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:47.647664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.693649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdfb7d-4303-4c57-9cae-001595d6a8db admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.700752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.701463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.701749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.702026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.702753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.704351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.711053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1159/2321] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:47.714433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.717452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1163/2322] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:47.720927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.725736 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e37e-f6d8-49d8-9b1a-3d30d27a8ac4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.732405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e1bd5-fa26-4f26-a875-6e209508eda0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.735892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.736584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.736888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.737603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.738357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.740931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4ddb5-0fd2-4a7d-80b9-843729453d79 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.745215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.746249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.746526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.746841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] PATH_INFO: `/v3/projects/7368e46aa5044c019587913e5d1fa999/users/28294fe0d3414f8aa325835e2c354a4f/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.759639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1160/2323] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:47.759639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916778-c18a-4ccf-a844-366692539292 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.759639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916778-c18a-4ccf-a844-366692539292 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.759639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3916778-c18a-4ccf-a844-366692539292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.763252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7368e46aa5044c019587913e5d1fa999, user_id=28294fe0d3414f8aa325835e2c354a4f, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.766107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba311d4-4d3f-4424-aecb-ea8a29b1c779 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.781094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c3916778-c18a-4ccf-a844-366692539292 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:47.782358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c3916778-c18a-4ccf-a844-366692539292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.790626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1161/2324] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:47.791450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3916778-c18a-4ccf-a844-366692539292 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.800923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3916778-c18a-4ccf-a844-366692539292 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.805492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.806396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.806678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.806951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] PATH_INFO: `/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3/users/77879cdfb77640ba9a43584ea9e4d47a/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.809119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd472a8d6c9a4b1fac0d718433b816e3, user_id=77879cdfb77640ba9a43584ea9e4d47a, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.811769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.821659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1162/2325] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:47 2022] PUT /identity/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3/users/77879cdfb77640ba9a43584ea9e4d47a/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:47.822398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.851640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1164/2326] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:47 2022] PUT /identity/v3/projects/7368e46aa5044c019587913e5d1fa999/users/28294fe0d3414f8aa325835e2c354a4f/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:47.852876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.853167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.853482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.883065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] MFA Rules not processed for user `77879cdfb77640ba9a43584ea9e4d47a`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:47.884163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.908583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c7e7-c0f4-4add-bd6f-a7255dc06b1f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.968293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.968964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.969331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.969557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.970272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:47.970675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.974925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1165/2327] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:47.974925 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.975221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:47.985121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1163/2328] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:47.985321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2149c-2977-430c-ae07-25d8f5f2266e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:47.985677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:47.989519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:47.992088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:47.992784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:47.993070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:47.993386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:47.997672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:47.997672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.010753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1166/2329] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:48.010753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.020841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474576cf-550c-48ae-acce-40e6fad2d9a9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.025936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.026754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.027203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.027511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.028429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.030478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d654ff-b1b2-43e0-b9d3-dd2af206da40 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.049455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8452c66-ce48-4593-a545-2f1f571a059e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.053116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.053779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.059053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.059053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.064534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.066186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.078022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1164/2330] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:48.078925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.091311 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91fa37-8e89-4973-88e8-d165f4902f03 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.096265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.097177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.097594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.097883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] PATH_INFO: `/v3/projects/7368e46aa5044c019587913e5d1fa999/users/28294fe0d3414f8aa325835e2c354a4f/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.099927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7368e46aa5044c019587913e5d1fa999, user_id=28294fe0d3414f8aa325835e2c354a4f, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.102628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.114336 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1165/2331] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:48 2022] PUT /identity/v3/projects/7368e46aa5044c019587913e5d1fa999/users/28294fe0d3414f8aa325835e2c354a4f/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:48.117807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1167/2332] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:48 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:48.118646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.125481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.125777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.126059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.154444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] MFA Rules not processed for user `28294fe0d3414f8aa325835e2c354a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:48.160914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:48.189761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629ddd6d-5be1-4b53-a7a1-0a8579ae1347 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.240285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1168/2333] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:48.248131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.259754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.260763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.261423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.262566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.263343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.266293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.312064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204d1e99-8485-4821-93db-dedfc923ed10 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.315910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.316591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.316878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.317161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.319064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:48.377074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1166/2334] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:48 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:48.378009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.387490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.389051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.398679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1169/2335] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:48.399451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.410467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd0f0a-2ab8-4165-8099-99c98b538a53 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.415761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.416625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.417046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.417382 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.418773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04258a99-907a-49fe-abea-ee1ed7a2e64c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.418910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.420924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.428515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.429391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.429832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.431800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.432177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1170/2336] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:48.436472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:48.438077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.455339 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f3974-e316-40d6-a9e3-4930ab4d0207 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.461723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.462562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.463229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.463683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.465540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.470836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.486952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1171/2337] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:48.490837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:48.505586 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b82a4-ec04-4be2-b020-70f195b4fa30 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:48.514711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:48.519394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.519394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.519394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] PATH_INFO: `/v3/projects/bd9e462beaa546ceb94f78585967397c/users/ce16cc54d912474e9264827e54b9891c/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.530402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.544589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422516f-82dd-4556-9670-2ae5ea5941e1 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.552910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1167/2338] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:48.557780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9e462beaa546ceb94f78585967397c, user_id=ce16cc54d912474e9264827e54b9891c, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:48.562529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:48.674723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:48.687664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1172/2339] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:48 2022] PUT /identity/v3/projects/bd9e462beaa546ceb94f78585967397c/users/ce16cc54d912474e9264827e54b9891c/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:48.708287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:48.708287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:48.708287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:48.740972 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] MFA Rules not processed for user `ce16cc54d912474e9264827e54b9891c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:48.742231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:48.821980 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1168/2340] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:48.983364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:49.391446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:49.483488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c57621-aeff-4db1-b751-bb0da442a62f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:49.490548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:49.491440 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:49.491628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:49.491926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:49.503198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:49.506212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:49.517326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1173/2341] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:50.203544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:50.518046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:50.519612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:50.628274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade817a1-1b13-4171-9674-690ad3bd27cf None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:50.632962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:50.633887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:50.634176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:50.634458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] PATH_INFO: `/v3/users/80560f93b6ec4eee95a47991336fcf18` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:50.635656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] RBAC: Authorizing `identity:delete_user(user_id=80560f93b6ec4eee95a47991336fcf18)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:50.638338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:50.752447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:50.837639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80560f93b6ec4eee95a47991336fcf18'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:50.851606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80560f93b6ec4eee95a47991336fcf18'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:50.861827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:50.873615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7366e00c-e866-4b72-a05e-a562e5a4bb8d service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:50.877396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:50.878047 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:50.878521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:50.878744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:50.880909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:50.944858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:50.946345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee471d5-df6e-4ede-85da-e851e0745090 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:50.955762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1174/2342] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:50.972664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80560f93b6ec4eee95a47991336fcf18'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:50.973663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80560f93b6ec4eee95a47991336fcf18'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:50.979623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80560f93b6ec4eee95a47991336fcf18'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:50.993946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1169/2343] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:50 2022] DELETE /identity/v3/users/80560f93b6ec4eee95a47991336fcf18 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:50.998552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:50.998846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:50.999132 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:51.016766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:51.018001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:51.076806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1175/2344] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:51.086637 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:51.088306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:51.092552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:51.158462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba7d6a-83f2-4c77-aee2-b40718640fae admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:51.162374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:51.163095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:51.163416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:51.163697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:51.173598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:51.175090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:51.184462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1170/2345] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:51.370850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:51.372930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:51.385387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2dfb6-ee47-4d42-bc5c-76d6f00f4641 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:51.392262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:51.393172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:51.394238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:51.394238 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] PATH_INFO: `/v3/users/b5da1e9424364ecbb9ec2b7a513e1bc1` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:51.395515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5da1e9424364ecbb9ec2b7a513e1bc1)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:51.397710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:51.687891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5da1e9424364ecbb9ec2b7a513e1bc1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.688632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5da1e9424364ecbb9ec2b7a513e1bc1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.701314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5da1e9424364ecbb9ec2b7a513e1bc1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.727506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:51.730089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:51.751982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773e838-3cf4-46a9-a87b-20fc61dbfc89 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:51.757720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:51.758661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:51.759019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:51.759362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] PATH_INFO: `/v3/projects/464e8c4dcac04029bbbbf9b3457f8eb0` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:51.760609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=464e8c4dcac04029bbbbf9b3457f8eb0)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:51.762727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:51.810011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:51.811688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5da1e9424364ecbb9ec2b7a513e1bc1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.812525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-42c9bf88-3ed0-4850-9e2b-a1fef798a4ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5da1e9424364ecbb9ec2b7a513e1bc1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.826146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1176/2346] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:51 2022] DELETE /identity/v3/users/b5da1e9424364ecbb9ec2b7a513e1bc1 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:51.831290 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:51.831762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:51.832272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:51.859522 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:51.860927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:51.926283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1177/2347] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:51.937801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464e8c4dcac04029bbbbf9b3457f8eb0', 'request_id': 'req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.944058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464e8c4dcac04029bbbbf9b3457f8eb0', 'request_id': 'req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.949441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464e8c4dcac04029bbbbf9b3457f8eb0', 'request_id': 'req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:51.965023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:51.966832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.028655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12377bc5-4d6c-4781-bd30-96768d3ffdfe None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:52.040390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] The token cache is being invalidate because project 464e8c4dcac04029bbbbf9b3457f8eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:52.040840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.042033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.064076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1171/2348] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:51 2022] DELETE /identity/v3/projects/464e8c4dcac04029bbbbf9b3457f8eb0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:52.068952 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:52.074449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.114670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:52.116266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:52.116994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:52.117450 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:52.120479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.185085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1b1fb-026f-47dc-ad8e-3fd6cfb046fb admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:52.190035 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:52.198189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:52.198189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:52.198189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] PATH_INFO: `/v3/users/399a31a0db5a4067bf3ce1f4bd4c1627` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:52.198189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] RBAC: Authorizing `identity:delete_user(user_id=399a31a0db5a4067bf3ce1f4bd4c1627)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:52.198189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:52.210884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:52.212354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:52.222930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1178/2349] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:52.300174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:52.379352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399a31a0db5a4067bf3ce1f4bd4c1627'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.390858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399a31a0db5a4067bf3ce1f4bd4c1627'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.484856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399a31a0db5a4067bf3ce1f4bd4c1627'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.485504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399a31a0db5a4067bf3ce1f4bd4c1627'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.486126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399a31a0db5a4067bf3ce1f4bd4c1627'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:52.504529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1172/2350] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:52 2022] DELETE /identity/v3/users/399a31a0db5a4067bf3ce1f4bd4c1627 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:52.728484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:52.729980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.787724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a11015-34c5-44d1-819c-1c6cf2861206 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:52.814169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:52.819279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.860923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:52.861773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:52.862064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:52.862347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:52.864585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:52.938525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1edc11-5850-4b06-b79b-0b0b2185608b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:52.951785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:52.952689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:52.952975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:52.953251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] PATH_INFO: `/v3/projects/b0dc5b50bdec4ef7b17f1dc014356e5d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:52.958817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0dc5b50bdec4ef7b17f1dc014356e5d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:52.960775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.028338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.030909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.049230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1179/2351] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:53.131753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0dc5b50bdec4ef7b17f1dc014356e5d', 'request_id': 'req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.144614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.152464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.154976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0dc5b50bdec4ef7b17f1dc014356e5d', 'request_id': 'req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.160797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0dc5b50bdec4ef7b17f1dc014356e5d', 'request_id': 'req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.175874 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8de55-90d8-4baf-af91-183afa1553e8 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.246709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.246709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.246709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.246709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] PATH_INFO: `/v3/projects/0a47a9e0c33d404b82dda27d3061be48` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.247830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a47a9e0c33d404b82dda27d3061be48)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.249906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.283518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] The token cache is being invalidate because project b0dc5b50bdec4ef7b17f1dc014356e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:53.283813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.284488 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1cb3b647-1303-4c2e-97ac-d6dfd808dc66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.286096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1173/2352] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:52 2022] DELETE /identity/v3/projects/b0dc5b50bdec4ef7b17f1dc014356e5d => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:53.290754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae895e-7b54-44f7-a0ca-28a685512bd2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.291109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae895e-7b54-44f7-a0ca-28a685512bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.291455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae895e-7b54-44f7-a0ca-28a685512bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.311065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5eae895e-7b54-44f7-a0ca-28a685512bd2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:53.312284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5eae895e-7b54-44f7-a0ca-28a685512bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.320582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1174/2353] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:53.328379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.328673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.329042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.348884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:53.356251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.360111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1175/2354] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:53.364692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.374712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5a8fc-c7e6-4f92-87c3-2724fd8580c0 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.379884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.380554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.380842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.381133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.381906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:53.382221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.383880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.397068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1176/2355] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:53.404845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.409325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:53.422144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8233e17c-bb41-4ad6-b029-08b24f5a8986 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.437818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a47a9e0c33d404b82dda27d3061be48', 'request_id': 'req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.447965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a47a9e0c33d404b82dda27d3061be48', 'request_id': 'req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.457090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a47a9e0c33d404b82dda27d3061be48', 'request_id': 'req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.493962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.494616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.494897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.495170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.496968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.498837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.628464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] The token cache is being invalidate because project 0a47a9e0c33d404b82dda27d3061be48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:53.628775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.629460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c42f9c9-17fe-43e4-8059-5c89c524e7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:53.631065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1180/2356] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:53 2022] DELETE /identity/v3/projects/0a47a9e0c33d404b82dda27d3061be48 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:53.635853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf1f7-632a-45ac-a8cc-2609a5bf3dce None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.636171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf1f7-632a-45ac-a8cc-2609a5bf3dce None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.636990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dcf1f7-632a-45ac-a8cc-2609a5bf3dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.655951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-69dcf1f7-632a-45ac-a8cc-2609a5bf3dce None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:53.657130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-69dcf1f7-632a-45ac-a8cc-2609a5bf3dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.662770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1177/2357] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/projects => generated 371 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:53.667003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.667253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1181/2358] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:53.669012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.675565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.675978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.676153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.695698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:53.697627 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.742687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70423dc5-66b8-41c1-a286-a06c1946a11e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.747933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.748568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.748864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.749143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.749928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.751925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.779672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1182/2359] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:53.783859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.792472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2cda1-1515-4fca-b006-d79328bf5249 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.797077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.797742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.798024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.798297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.799006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:53.799310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.800880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.812259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1183/2360] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:39:53.816407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.827652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab51af-3f87-4fd7-8e8c-c49a4a7cb569 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.836962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.836962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.836962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.836962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.837417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.837417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.907540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1178/2361] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:53.911526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.924478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53892b-e915-4377-a46b-105d979028aa admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:53.931420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:53.932074 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:53.932325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:53.932816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:53.933445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:53.941293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:53.945285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1184/2362] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:53.946808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.949146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:53.953663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1179/2363] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:53.954655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:53.966823 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efb46f-9807-4f82-90a5-f5b7fec9e204 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.025828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e15250-d50f-4dd6-9eb0-f6ef0fd66205 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.032261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.036524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.036524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.036524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] PATH_INFO: `/v3/users/b2593727b2884727812a6e8a8474c148` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.036524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2593727b2884727812a6e8a8474c148)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.037001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.037492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.038232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.038614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.038791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.039492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.041493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.060263 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:54.159757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1180/2364] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:53 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:54.160452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.172315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93132ff-5d4e-45ac-adb7-b96ac0f5f4de admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.178101 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.178782 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.179118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.179404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.180141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.181818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.192974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1181/2365] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:54.198118 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.211892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade02457-2fb3-4ec9-9bfb-7ebad0476b54 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.223073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.223750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.224037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.224317 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.225049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.226915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.241576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1182/2366] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:54.241576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.249799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413955ac-aa90-489d-8393-07a795a6d0bd admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.254651 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.255606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.255931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.256300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] PATH_INFO: `/v3/projects/2f56f3f52779431f83d5a57257c4db37/users/bc4fdb662cd047bdaf85290e20e8163e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.272177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f56f3f52779431f83d5a57257c4db37, user_id=bc4fdb662cd047bdaf85290e20e8163e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.274991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.286384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2593727b2884727812a6e8a8474c148'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:54.287168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2593727b2884727812a6e8a8474c148'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:54.300521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2593727b2884727812a6e8a8474c148'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:54.400472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1183/2367] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:54 2022] PUT /identity/v3/projects/2f56f3f52779431f83d5a57257c4db37/users/bc4fdb662cd047bdaf85290e20e8163e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:54.408236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.422475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2593727b2884727812a6e8a8474c148'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:54.423222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-6f36dc7e-536f-498e-8da8-92405d5f4a6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2593727b2884727812a6e8a8474c148'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:54.437462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1185/2368] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:53 2022] DELETE /identity/v3/users/b2593727b2884727812a6e8a8474c148 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:54.441818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9766d-bb7c-48c8-87de-83a90c542fb0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.442181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9766d-bb7c-48c8-87de-83a90c542fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.442471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9766d-bb7c-48c8-87de-83a90c542fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.477206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b9f96-f506-481e-a9ed-1124a6d46611 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.480780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-61c9766d-bb7c-48c8-87de-83a90c542fb0 None None] MFA Rules not processed for user `bc4fdb662cd047bdaf85290e20e8163e`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:54.482175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-61c9766d-bb7c-48c8-87de-83a90c542fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.570010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.570799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.571147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.571537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.572334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.574608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.576830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1186/2369] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:54.578417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.578718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.579447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.591891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1184/2370] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:54.592607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.602934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:54.603708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.605039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.619168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1187/2371] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:54.619944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.621465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.637150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2c8b7-3bb6-4ed5-b942-5b9bc18d0cbe None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.642281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.643231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.643499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.643766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] PATH_INFO: `/v3/projects/1977b03e43ed48b0bd7e16878aa2d5dd/users/578c0e26b5a8441b899326c57eff148a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.660357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1977b03e43ed48b0bd7e16878aa2d5dd, user_id=578c0e26b5a8441b899326c57eff148a, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.663190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.679618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205c0fa-8b06-4ca5-901f-ddecc8364caa admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.683356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.684242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.684455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.684732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.697239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.698710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.708196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1185/2372] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:54.710213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.711562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.755350 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1188/2373] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:54 2022] PUT /identity/v3/projects/1977b03e43ed48b0bd7e16878aa2d5dd/users/578c0e26b5a8441b899326c57eff148a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:54.756245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.758167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.775007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563fb1a-01d9-4b70-b1c2-f219f88a002e service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.821853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cb2d5-578d-47bc-9ad4-8891b0ce34ad admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.833027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.833027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.833027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.833027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] PATH_INFO: `/v3/users/bc4fdb662cd047bdaf85290e20e8163e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.834103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4fdb662cd047bdaf85290e20e8163e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.834480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.835200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.835485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.835763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.836804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.848717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.850567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2930-7348-4bfb-8d84-c403e0be512b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:54.862590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1186/2374] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:54.863939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.864241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.864504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.892081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] MFA Rules not processed for user `578c0e26b5a8441b899326c57eff148a`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:54.893297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:54.963994 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1187/2375] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:54.968484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:54.979518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49db22-fb10-444d-857d-eb1c3db9c1cb None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:54.985632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:54.986303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:54.986599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:54.986872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:54.987563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:54.989587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.159972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4fdb662cd047bdaf85290e20e8163e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.160668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4fdb662cd047bdaf85290e20e8163e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.174404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4fdb662cd047bdaf85290e20e8163e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.207854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1188/2376] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:54 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:55.211731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.286481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef68cc-4ce5-431a-9e20-01e3ce780731 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.300108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.300813 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.301155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.301462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.302322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.304315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75ea92-be95-4600-b92f-13ef19b47daf admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.365315 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4fdb662cd047bdaf85290e20e8163e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.367361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:55.375980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4fdb662cd047bdaf85290e20e8163e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.387410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1189/2377] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:54 2022] DELETE /identity/v3/users/bc4fdb662cd047bdaf85290e20e8163e => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:55.387410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.388639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.424511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1189/2378] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:55 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:39:55.427646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.431108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.431537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.460703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:55.468940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.471506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b8845-9f73-4af9-8f89-70a55f4015da admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.476900 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.477559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1190/2379] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:55.478397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.478646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.479301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.479745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.480013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] PATH_INFO: `/v3/projects/2c3bf6cc9feb4b69bb341eb7d8c08d28` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.482421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c3bf6cc9feb4b69bb341eb7d8c08d28)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.484704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.492612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b122c-f2ed-4b13-b06e-2b73d1ec22e3 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.502976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.504089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.504384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.505075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.505942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.507567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.521348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1191/2380] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:55.521492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.531924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.607723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f368fca-23a8-4559-b1d2-abbc050c7ca1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.611371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.612025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.612328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.612619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.622979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.624409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.635061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1192/2381] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:55.635709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.663230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c3bf6cc9feb4b69bb341eb7d8c08d28', 'request_id': 'req-268de06d-45da-450d-b171-e7dd3c6c8f03'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.672411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f21cccd-f7d1-4bbb-a339-0396e676ffab service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.672528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c3bf6cc9feb4b69bb341eb7d8c08d28', 'request_id': 'req-268de06d-45da-450d-b171-e7dd3c6c8f03'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.679634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c3bf6cc9feb4b69bb341eb7d8c08d28', 'request_id': 'req-268de06d-45da-450d-b171-e7dd3c6c8f03'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.748273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.749217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.749585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.749875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] PATH_INFO: `/v3/projects/041fbaa99bed422ea82ed42c8add9971/users/5ae31fa7872e4041a0d889bef6d2961c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.767297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041fbaa99bed422ea82ed42c8add9971, user_id=5ae31fa7872e4041a0d889bef6d2961c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.770048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.832880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] The token cache is being invalidate because project 2c3bf6cc9feb4b69bb341eb7d8c08d28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:55.833175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.833885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:55.835469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1190/2382] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:55 2022] DELETE /identity/v3/projects/2c3bf6cc9feb4b69bb341eb7d8c08d28 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:55.839554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.841188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.854014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268de06d-45da-450d-b171-e7dd3c6c8f03 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.859056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:55.859482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.860466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.861348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.861348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] PATH_INFO: `/v3/users/39786d1422634885b5c0dab563104465` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.864921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=39786d1422634885b5c0dab563104465)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.864921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.865441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1193/2383] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:55 2022] PUT /identity/v3/projects/041fbaa99bed422ea82ed42c8add9971/users/5ae31fa7872e4041a0d889bef6d2961c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:55.869450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.871803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:55.953574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99390eaa-83e2-4118-b850-5df4e4253241 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.958747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.959639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.960057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.960348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:55.961088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:55.962800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:55.977299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1194/2384] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:39:55.979783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:55.991524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387df75f-e7fb-478c-b8df-f17bc8288621 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:55.997236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:55.998522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:55.998812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:55.999091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] PATH_INFO: `/v3/projects/041fbaa99bed422ea82ed42c8add9971/users/5ae31fa7872e4041a0d889bef6d2961c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:56.001219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=041fbaa99bed422ea82ed42c8add9971, user_id=5ae31fa7872e4041a0d889bef6d2961c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:56.003969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e135b-55db-4597-b108-e41b5929da99 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:56.016867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1195/2385] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:55 2022] PUT /identity/v3/projects/041fbaa99bed422ea82ed42c8add9971/users/5ae31fa7872e4041a0d889bef6d2961c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:56.028447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:56.028743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:56.029144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:56.045790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:56.061219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] MFA Rules not processed for user `5ae31fa7872e4041a0d889bef6d2961c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:56.062521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:56.137943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1196/2386] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:56 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:56.149979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:56.151313 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:56.158284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39786d1422634885b5c0dab563104465'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.159009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39786d1422634885b5c0dab563104465'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.171714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39786d1422634885b5c0dab563104465'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.211827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d749c-f531-4d56-ae07-f5cbf75d641e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:56.216707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:56.217410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:56.217695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:56.217970 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:56.227988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:56.229548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:56.240410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1197/2387] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:56.299921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39786d1422634885b5c0dab563104465'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.300626 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39786d1422634885b5c0dab563104465'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.315448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1191/2388] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:55 2022] DELETE /identity/v3/users/39786d1422634885b5c0dab563104465 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:56.400221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:56.409645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1ee0-3943-47a7-b3de-35a181666bbd service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:56.454090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:56.456294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:56.467475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:56.468144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:56.470127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:56.470127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:56.472149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:56.538331 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f986c2-20da-4f63-850e-73cccd7b23cf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:56.543093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:56.543957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:56.544243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:56.544518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] PATH_INFO: `/v3/projects/2f56f3f52779431f83d5a57257c4db37` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:56.545837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f56f3f52779431f83d5a57257c4db37)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:56.547814 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:56.566802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:56.568838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:56.584383 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1198/2389] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:39:56.690353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f56f3f52779431f83d5a57257c4db37', 'request_id': 'req-eaa55f63-f5bb-42e8-990b-9969286d8c94'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.698477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f56f3f52779431f83d5a57257c4db37', 'request_id': 'req-eaa55f63-f5bb-42e8-990b-9969286d8c94'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.760335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f56f3f52779431f83d5a57257c4db37', 'request_id': 'req-eaa55f63-f5bb-42e8-990b-9969286d8c94'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.850098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] The token cache is being invalidate because project 2f56f3f52779431f83d5a57257c4db37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:56.850915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.852437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:56.856974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1192/2390] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:56 2022] DELETE /identity/v3/projects/2f56f3f52779431f83d5a57257c4db37 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:56.985193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:56.988027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:57.010818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c48e79-4f38-46f2-9880-e384df49ce7f service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:57.123266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:57.124142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:57.124525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:57.124805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] PATH_INFO: `/v3/projects/fe9fea42ce8247ddbcec43c52a00a8dd` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:57.126028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe9fea42ce8247ddbcec43c52a00a8dd)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:57.127949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:57.286140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe9fea42ce8247ddbcec43c52a00a8dd', 'request_id': 'req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.292332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe9fea42ce8247ddbcec43c52a00a8dd', 'request_id': 'req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.301867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe9fea42ce8247ddbcec43c52a00a8dd', 'request_id': 'req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.446372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] The token cache is being invalidate because project fe9fea42ce8247ddbcec43c52a00a8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:57.446796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.447989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.462754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1199/2391] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:56 2022] DELETE /identity/v3/projects/fe9fea42ce8247ddbcec43c52a00a8dd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:57.476264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:57.478550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:57.494265 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f63-f5bb-42e8-990b-9969286d8c94 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:57.615989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:57.616890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:57.617178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:57.617498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] PATH_INFO: `/v3/users/77879cdfb77640ba9a43584ea9e4d47a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:57.625753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77879cdfb77640ba9a43584ea9e4d47a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:57.627711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:57.940150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77879cdfb77640ba9a43584ea9e4d47a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.940889 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77879cdfb77640ba9a43584ea9e4d47a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:57.953224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77879cdfb77640ba9a43584ea9e4d47a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:58.037358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77879cdfb77640ba9a43584ea9e4d47a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:58.038020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77879cdfb77640ba9a43584ea9e4d47a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:58.053320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1193/2392] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:57 2022] DELETE /identity/v3/users/77879cdfb77640ba9a43584ea9e4d47a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:58.607475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:58.609814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:58.644983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6113a3-6cdb-4fb5-8c7a-dcaa82f693a5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:58.659632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:58.661785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:58.715257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:58.716478 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:58.716934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:58.717247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] PATH_INFO: `/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:58.718733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd472a8d6c9a4b1fac0d718433b816e3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:58.720790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:58.752774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3dd91-39d0-4a32-bf13-665d23583bbf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:58.757736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:58.758884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:58.759187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:58.759453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] PATH_INFO: `/v3/users/643fcea62b14478c8656abb04782f280` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:58.760688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=643fcea62b14478c8656abb04782f280)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:58.763167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:58.879357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd472a8d6c9a4b1fac0d718433b816e3', 'request_id': 'req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:58.886029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd472a8d6c9a4b1fac0d718433b816e3', 'request_id': 'req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:58.892934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd472a8d6c9a4b1fac0d718433b816e3', 'request_id': 'req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.011434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:59.017955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] The token cache is being invalidate because project cd472a8d6c9a4b1fac0d718433b816e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:39:59.018246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.018907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a1cd1e30-8f05-4fe9-9e3a-6ae0693b3a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.020805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1200/2393] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:39:58 2022] DELETE /identity/v3/projects/cd472a8d6c9a4b1fac0d718433b816e3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:59.024592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '643fcea62b14478c8656abb04782f280'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.025297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '643fcea62b14478c8656abb04782f280'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.026850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c8872-1636-4a70-9a4c-49681f686c17 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.027495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c8872-1636-4a70-9a4c-49681f686c17 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.028175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c8872-1636-4a70-9a4c-49681f686c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.039096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '643fcea62b14478c8656abb04782f280'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.057738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b37c8872-1636-4a70-9a4c-49681f686c17 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:59.059599 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b37c8872-1636-4a70-9a4c-49681f686c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.116612 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1201/2394] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:59.127449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.127735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.128011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.155330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:59.156680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.165250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1202/2395] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:59.170108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.179260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8a78-9d19-4fea-b3a8-a13da5b04b7b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.184873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.185572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.185858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.186154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.186864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:39:59.187169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.188777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.205176 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1203/2396] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:39:59.206077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.209192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '643fcea62b14478c8656abb04782f280'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.210072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2f0597c2-6296-49ab-833f-f3b96aab4caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '643fcea62b14478c8656abb04782f280'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:39:59.217577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee871e-b10b-4f10-9801-bf891d002d9e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.233417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1194/2397] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:39:58 2022] DELETE /identity/v3/users/643fcea62b14478c8656abb04782f280 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:39:59.234699 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.234952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.235252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.235536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.236387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.236683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.236964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.237707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.239591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.245431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:39:59.262705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:59.264084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.335688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1195/2398] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:39:59.346079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.347456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.355055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1204/2399] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/projects => generated 371 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:59.359775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.361411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.408050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be863bf2-f3de-4c0d-b3be-f62842b09c67 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.425849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d4069-a4ed-4713-8504-07f256b363df admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.430818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.431573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.431816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.432092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.432775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.434920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.466848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.467701 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.467996 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.468276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.479018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.481500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.491950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1196/2400] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:39:59.543425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1205/2401] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:39:59.546789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.559721 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d702181-c485-474d-8bca-9d3745681752 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.564862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.565778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.566138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.566892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.567385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.569234 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.585168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1197/2402] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:59.585851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.597598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b093b47-d49c-48ba-aec2-13c12e1e4ce2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.602372 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.603128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.603483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.603829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.604622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.606437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e97cc-280d-44ff-8926-9f10c3b52250 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.620122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1206/2403] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:39:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:39:59.640342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.640342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55370611-37ba-486c-80e3-99fa022a10eb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:39:59.640342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:39:59.640342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.640732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.640732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] PATH_INFO: `/v3/projects/5bd582db99e44fb5892bc51a69344bc4/users/627c76a6970e4436919c9eea38aaae5d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.656862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd582db99e44fb5892bc51a69344bc4, user_id=627c76a6970e4436919c9eea38aaae5d, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:39:59.659544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:39:59.773341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1198/2404] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:39:59 2022] PUT /identity/v3/projects/5bd582db99e44fb5892bc51a69344bc4/users/627c76a6970e4436919c9eea38aaae5d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:39:59.793066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:39:59.793659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:39:59.794096 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:39:59.843438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] MFA Rules not processed for user `627c76a6970e4436919c9eea38aaae5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:39:59.844915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.925437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1207/2405] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:39:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:39:59.936929 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:39:59.938647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:39:59.999425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d134e6-12de-4ae5-bb05-d330e26af964 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.003223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.003875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.004162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.004462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.013784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:00.015296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:00.024342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1199/2406] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:39:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:00.044556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:00.063527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:00.066267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:00.125536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463eb5e-1ee2-4937-b29b-63007cba16ae None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.134028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.134905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.135193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.135492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] PATH_INFO: `/v3/users/627c76a6970e4436919c9eea38aaae5d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.137384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=627c76a6970e4436919c9eea38aaae5d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:00.139346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:00.156174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e8c7d-eddd-47f6-9467-21e5edc91cd2 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.161066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.161970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.162264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.162546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] PATH_INFO: `/v3/projects/404c8689a66f411ab53411e29287ebbf` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.163921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404c8689a66f411ab53411e29287ebbf)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:00.165892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:00.473230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404c8689a66f411ab53411e29287ebbf', 'request_id': 'req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.474925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '627c76a6970e4436919c9eea38aaae5d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.479531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404c8689a66f411ab53411e29287ebbf', 'request_id': 'req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.486812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404c8689a66f411ab53411e29287ebbf', 'request_id': 'req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.487727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '627c76a6970e4436919c9eea38aaae5d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.580947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] The token cache is being invalidate because project 404c8689a66f411ab53411e29287ebbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:00.581247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.581926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.583477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1200/2407] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:00 2022] DELETE /identity/v3/projects/404c8689a66f411ab53411e29287ebbf => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:00.587365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:00.588906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:00.653647 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f475c415-a1b9-4ee1-9ea2-f59c3638c5c1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.658150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.659024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.659303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.659583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] PATH_INFO: `/v3/users/f83cfc1ea6144743966c3bd83ff4360d` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.660024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '627c76a6970e4436919c9eea38aaae5d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.660875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '627c76a6970e4436919c9eea38aaae5d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.660999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83cfc1ea6144743966c3bd83ff4360d)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:00.661638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-d5101b46-cf40-49aa-b914-ac54e9ea8cc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '627c76a6970e4436919c9eea38aaae5d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.662949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:00.675916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1208/2408] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:00 2022] DELETE /identity/v3/users/627c76a6970e4436919c9eea38aaae5d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:00.680516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.680943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.681228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.699015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:00.700235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:00.764916 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1209/2409] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:00.771412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:00.772759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:00.837844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8454ad1-965c-4003-ac33-44b0d321a377 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:00.845615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:00.846767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:00.847818 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:00.848107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:00.860830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83cfc1ea6144743966c3bd83ff4360d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.861946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83cfc1ea6144743966c3bd83ff4360d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.864182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:00.866906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:00.875162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:00.876395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83cfc1ea6144743966c3bd83ff4360d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.891290 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1210/2410] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:00.998981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83cfc1ea6144743966c3bd83ff4360d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:00.999607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83cfc1ea6144743966c3bd83ff4360d'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.012477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1201/2411] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:00 2022] DELETE /identity/v3/users/f83cfc1ea6144743966c3bd83ff4360d => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:01.358445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.359542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.383413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c22b3-36ac-4697-ba5c-e6d7c17d7720 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.445769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.446546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.446833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.447113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] PATH_INFO: `/v3/projects/5bd582db99e44fb5892bc51a69344bc4` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.448344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd582db99e44fb5892bc51a69344bc4)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.451089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.504707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.506430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.539660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe175fb-1f46-49d5-8023-18dbcec91871 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.546029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.547098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.547573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.547974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] PATH_INFO: `/v3/projects/6dae5ed3a3154bd6b72dae0102640ba2` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.552109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dae5ed3a3154bd6b72dae0102640ba2)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.552109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.589206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd582db99e44fb5892bc51a69344bc4', 'request_id': 'req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.596629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd582db99e44fb5892bc51a69344bc4', 'request_id': 'req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.603834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd582db99e44fb5892bc51a69344bc4', 'request_id': 'req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.721966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:01.724353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] The token cache is being invalidate because project 5bd582db99e44fb5892bc51a69344bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:01.724842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.725448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e1601a37-bf78-4ee4-b0eb-fadc479a68d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.727165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1211/2412] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:01 2022] DELETE /identity/v3/projects/5bd582db99e44fb5892bc51a69344bc4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:01.731893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4042c-3928-44e6-a13f-6b17ec2d0c42 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.732185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4042c-3928-44e6-a13f-6b17ec2d0c42 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.732467 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4042c-3928-44e6-a13f-6b17ec2d0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.738537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dae5ed3a3154bd6b72dae0102640ba2', 'request_id': 'req-dcac0502-4b17-4a93-b72f-58617da062db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.745087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dae5ed3a3154bd6b72dae0102640ba2', 'request_id': 'req-dcac0502-4b17-4a93-b72f-58617da062db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.752490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dae5ed3a3154bd6b72dae0102640ba2', 'request_id': 'req-dcac0502-4b17-4a93-b72f-58617da062db'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.755517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a4c4042c-3928-44e6-a13f-6b17ec2d0c42 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:01.756911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a4c4042c-3928-44e6-a13f-6b17ec2d0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.812735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] The token cache is being invalidate because project 6dae5ed3a3154bd6b72dae0102640ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:01.813188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.813949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:01.815836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1202/2413] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:01 2022] DELETE /identity/v3/projects/6dae5ed3a3154bd6b72dae0102640ba2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:01.820554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.828978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1212/2414] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:01.830077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.830619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.830910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.831187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.843220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac0502-4b17-4a93-b72f-58617da062db admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.848171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.849103 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:01.849242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.849486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.849853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] PATH_INFO: `/v3/users/28294fe0d3414f8aa325835e2c354a4f` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.850304 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:01.851102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28294fe0d3414f8aa325835e2c354a4f)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.853056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.858906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1213/2415] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:01.863887 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.873418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af02d67-79df-4836-9ead-0dc2b58e2cf1 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.878183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.878843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.879123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.882403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.882403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:01.882403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.882403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:01.894472 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1214/2416] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:01.898643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:01.908993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fd852-6bd5-4131-81de-5f296f512ce1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:01.913678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:01.914320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:01.914603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:01.914880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:01.915558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:01.917491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.063965 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1215/2417] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:01 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:02.067955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.126966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28294fe0d3414f8aa325835e2c354a4f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.127659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28294fe0d3414f8aa325835e2c354a4f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.134161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f1852-3179-43be-88d4-e2393e367228 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.140719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.141433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.141630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28294fe0d3414f8aa325835e2c354a4f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.141741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.141992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.142687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.144621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.164697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:02.272991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28294fe0d3414f8aa325835e2c354a4f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.273730 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28294fe0d3414f8aa325835e2c354a4f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.284865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1216/2418] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:02 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:02.286148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.288008 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.293953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1203/2419] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:01 2022] DELETE /identity/v3/users/28294fe0d3414f8aa325835e2c354a4f => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:02.308705 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d450-e9fa-41b1-85fa-2c7d69186749 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.322844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.325533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.407910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806383a-95ab-459d-a0ef-9c1708aea195 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.412736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.413741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.413897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.414167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.414444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] PATH_INFO: `/v3/users/578c0e26b5a8441b899326c57eff148a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.414628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.414919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.415203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.415805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=578c0e26b5a8441b899326c57eff148a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.415935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.418102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.418372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.431645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1217/2420] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:02.432989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.443244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a4055-3efa-469a-b62a-b64df03179a3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.447919 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.448655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.448957 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.449231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.449966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.451670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.462269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1218/2421] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:02.467361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.477102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faed1a93-0222-4188-b7d3-f1ff5d796158 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.483175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.484325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.484325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.484697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] PATH_INFO: `/v3/projects/9a1f6e51f01348c1b4c4d52bdbb3f80f/users/66ae41bb64db4c24abbfee5c97b90d20/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.501557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a1f6e51f01348c1b4c4d52bdbb3f80f, user_id=66ae41bb64db4c24abbfee5c97b90d20, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.504249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d492ac-7369-4e2c-8d88-54ccd93abb21 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.595993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1219/2422] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:02 2022] PUT /identity/v3/projects/9a1f6e51f01348c1b4c4d52bdbb3f80f/users/66ae41bb64db4c24abbfee5c97b90d20/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:02.607867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.608162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.608445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.610269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578c0e26b5a8441b899326c57eff148a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.611509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578c0e26b5a8441b899326c57eff148a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.624050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578c0e26b5a8441b899326c57eff148a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.637811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] MFA Rules not processed for user `66ae41bb64db4c24abbfee5c97b90d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:02.639014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.704235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1220/2423] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:02.708585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.723158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578c0e26b5a8441b899326c57eff148a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.724220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-03c43d35-f35e-46a8-9696-d573de92dad3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578c0e26b5a8441b899326c57eff148a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.738550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1204/2424] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:02 2022] DELETE /identity/v3/users/578c0e26b5a8441b899326c57eff148a => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:02.742879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.743218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.743503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.762375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:02.763632 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.780524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aef9f5-7a93-44bf-acb3-c3b302373887 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.837981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1205/2425] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:02.842032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.842032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:02.850462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.857689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.857689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.857689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.857689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.857689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.858112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b29689-ba6f-41f6-95c2-cd3a3b7ac19c None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:02.863574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:02.864444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:02.864728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:02.865167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] PATH_INFO: `/v3/projects/7368e46aa5044c019587913e5d1fa999` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:02.866409 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7368e46aa5044c019587913e5d1fa999)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:02.868570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:02.993880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1221/2426] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:02 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:02.995141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:02.997767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7368e46aa5044c019587913e5d1fa999', 'request_id': 'req-b1749b97-165d-43f3-b7b2-6e309fa64f5f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:02.999027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:03.005959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7368e46aa5044c019587913e5d1fa999', 'request_id': 'req-b1749b97-165d-43f3-b7b2-6e309fa64f5f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:03.013210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7368e46aa5044c019587913e5d1fa999', 'request_id': 'req-b1749b97-165d-43f3-b7b2-6e309fa64f5f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:03.063335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e466d-4157-45ff-bc52-835a98bb378f admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.067133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.067784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.068066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.068713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.106140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] The token cache is being invalidate because project 7368e46aa5044c019587913e5d1fa999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:03.106428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:03.108146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:03.113196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1206/2427] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:02 2022] DELETE /identity/v3/projects/7368e46aa5044c019587913e5d1fa999 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:03.114057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.115403 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:03.140982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.142458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bddf5-25ca-4199-98fa-a30de412c6aa service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.152776 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1222/2428] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:03.154236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30892ff-ac95-4d50-b26c-493f5d5d00d0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.154536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30892ff-ac95-4d50-b26c-493f5d5d00d0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.154833 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30892ff-ac95-4d50-b26c-493f5d5d00d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.175616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c30892ff-ac95-4d50-b26c-493f5d5d00d0 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:03.176837 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c30892ff-ac95-4d50-b26c-493f5d5d00d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:03.181019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749b97-165d-43f3-b7b2-6e309fa64f5f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.186664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.187587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1223/2429] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:03.189373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.189915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.190214 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.191130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.193293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.195369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.195659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.195936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.220510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:03.222438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:03.236262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1224/2430] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:03.237456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.249316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb44c0-ecc3-4998-b21b-76e89fb2cfb4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.254817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.255499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.255788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.256075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.257056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:03.257413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.259140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.272686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1225/2431] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:40:03.277409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.287713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef89cb58-b9f9-4c97-90e5-558edf9612a4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.293150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.294307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.294713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.295097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.295796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.297913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.308496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1207/2432] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:03 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:03.312612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.324948 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b16071-586f-4ba4-b38c-80bd9e77904c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.353523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.353523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.353523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.353523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.353970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.353970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.368208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1208/2433] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:03.372689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.387108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1afd7-ba03-4793-88b9-31cd3a151caa admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.393120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.394119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.394404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.394681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] PATH_INFO: `/v3/projects/7a50d96ac5594de98f552c88b7fc3cba/users/60c2341985e94f07a301feeef20b27a4/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.413587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a50d96ac5594de98f552c88b7fc3cba, user_id=60c2341985e94f07a301feeef20b27a4, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.416618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.446690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1226/2434] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:03 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:03.447418 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.449921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:03.516791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:03.853348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7d072-6c6a-4bf4-8a04-5a1cd2a78f33 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.855413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1209/2435] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:03 2022] PUT /identity/v3/projects/7a50d96ac5594de98f552c88b7fc3cba/users/60c2341985e94f07a301feeef20b27a4/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:03.855413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.855815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.855815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.855815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.855815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] PATH_INFO: `/v3/users/ce16cc54d912474e9264827e54b9891c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.856408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce16cc54d912474e9264827e54b9891c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.856408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.856570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989de11-92d0-4427-95a0-34923030c1da admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.856570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.856570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.856570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.856905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.856905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.856905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.897924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1210/2436] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:03 2022] POST /identity/v3/users => generated 288 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:03.897924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.905572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e8361-78fc-4544-a9c4-402e586f9cad admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.910491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.915576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.915576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.915576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.915576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.915576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.924921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1211/2437] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:03.925768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.941844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28f22d-8c6f-4f55-9167-37063b48f642 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.945271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.946026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.946308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.946595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.947322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.949631 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.962634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1212/2438] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:03.967733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:03.975075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8014bf5d-01c8-4f69-a231-41c2a121df20 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:03.980108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:03.981003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:03.981319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:03.981596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] PATH_INFO: `/v3/projects/7a50d96ac5594de98f552c88b7fc3cba/users/60c2341985e94f07a301feeef20b27a4/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:03.983620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a50d96ac5594de98f552c88b7fc3cba, user_id=60c2341985e94f07a301feeef20b27a4, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:03.986317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:03.998613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1213/2439] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:03 2022] PUT /identity/v3/projects/7a50d96ac5594de98f552c88b7fc3cba/users/60c2341985e94f07a301feeef20b27a4/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:03.999436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.001291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.007996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce16cc54d912474e9264827e54b9891c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.021979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce16cc54d912474e9264827e54b9891c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.068962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd808e3-0d72-4e61-9a10-3ea03a28ff50 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.075281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.076958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.077280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.077746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] PATH_INFO: `/v3/projects/1977b03e43ed48b0bd7e16878aa2d5dd` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.078962 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1977b03e43ed48b0bd7e16878aa2d5dd)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.080894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.114324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce16cc54d912474e9264827e54b9891c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.114873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce16cc54d912474e9264827e54b9891c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.115480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce16cc54d912474e9264827e54b9891c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.128610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1227/2440] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:03 2022] DELETE /identity/v3/users/ce16cc54d912474e9264827e54b9891c => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:04.131791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.131791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.205060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648dbe1-d371-4a37-b74f-78f6582968b3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.210506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.211495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.211984 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.212273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.213012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.216180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c2e091-b5eb-4320-94a1-5b3df5b57902 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.224673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1977b03e43ed48b0bd7e16878aa2d5dd', 'request_id': 'req-aff59a3f-a420-425e-9abd-10c505f46a87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.238113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1228/2441] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:04.238241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1977b03e43ed48b0bd7e16878aa2d5dd', 'request_id': 'req-aff59a3f-a420-425e-9abd-10c505f46a87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.238337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.238337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.238337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.238857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1977b03e43ed48b0bd7e16878aa2d5dd', 'request_id': 'req-aff59a3f-a420-425e-9abd-10c505f46a87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.259820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] MFA Rules not processed for user `60c2341985e94f07a301feeef20b27a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:04.265479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.313825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:04.318548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] The token cache is being invalidate because project 1977b03e43ed48b0bd7e16878aa2d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:04.318844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.319482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aff59a3f-a420-425e-9abd-10c505f46a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.321071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1214/2442] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:03 2022] DELETE /identity/v3/projects/1977b03e43ed48b0bd7e16878aa2d5dd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:04.325739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.326031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.326313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.331958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1229/2443] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:04.332790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.345835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:04.346848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.399557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b16b1-70cb-4330-b1d6-b643ba8db825 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.405009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.405963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.406247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.406526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] PATH_INFO: `/v3/projects/ee6570b6008c48619ea9c0f9a7ad22f3/users/f63f21a56c5b487b8229b69256c3edda/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.409069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1215/2444] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:04.410225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.413982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.427672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85badca8-0c33-4c0e-abd2-188f6c8ddc97 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.432589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6570b6008c48619ea9c0f9a7ad22f3, user_id=f63f21a56c5b487b8229b69256c3edda, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.433692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.434726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.435109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.435486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] PATH_INFO: `/v3/users/5ae31fa7872e4041a0d889bef6d2961c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.435771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.438528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae31fa7872e4041a0d889bef6d2961c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.440572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.566618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1230/2445] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:04 2022] PUT /identity/v3/projects/ee6570b6008c48619ea9c0f9a7ad22f3/users/f63f21a56c5b487b8229b69256c3edda/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:04.574580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.576131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.634559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83d094-c3b1-4839-9930-a8e9d199a0f0 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.639215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.639888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.640170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.640445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.642255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.657617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae31fa7872e4041a0d889bef6d2961c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.658194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae31fa7872e4041a0d889bef6d2961c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.672070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae31fa7872e4041a0d889bef6d2961c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.701942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.705697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.712552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1231/2446] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:04.713628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.714940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.756967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae31fa7872e4041a0d889bef6d2961c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.757617 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-e62e30d3-bc77-4f04-ab31-2be9b2193466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae31fa7872e4041a0d889bef6d2961c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:04.771135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1216/2447] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:04 2022] DELETE /identity/v3/users/5ae31fa7872e4041a0d889bef6d2961c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:04.772676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.772867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.773126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.778653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b4337-9247-412e-905d-8c3aa9aa8eb3 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.800951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] MFA Rules not processed for user `f63f21a56c5b487b8229b69256c3edda`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:04.802196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.859753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.861233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.861584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.861872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.864981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.875775 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1217/2448] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:04.889209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:04.889209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:04.943018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.946836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.955774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01a9e8-579e-4820-b05b-4934298fc6b7 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:04.960122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:04.960615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1232/2449] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:04.960993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:04.961447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:04.961761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:04.973693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:04.973693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:04.985887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1218/2450] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:05.246464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:05.433735 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:05.435396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:05.465569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1314561-8aaf-4873-8927-1968d6d4b52e service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:05.471242 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:05.472124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.472408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.472825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] PATH_INFO: `/v3/projects/041fbaa99bed422ea82ed42c8add9971` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.474082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=041fbaa99bed422ea82ed42c8add9971)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:05.483976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:05.608428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:05.608428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:05.624480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041fbaa99bed422ea82ed42c8add9971', 'request_id': 'req-984bfee2-8367-4810-a306-8923f09ddf55'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.627501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64570ba-82c0-4026-a55a-51799b659cfb service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:05.633155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041fbaa99bed422ea82ed42c8add9971', 'request_id': 'req-984bfee2-8367-4810-a306-8923f09ddf55'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.642259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041fbaa99bed422ea82ed42c8add9971', 'request_id': 'req-984bfee2-8367-4810-a306-8923f09ddf55'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.706302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:05.707367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.707687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.707965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] PATH_INFO: `/v3/projects/bd9e462beaa546ceb94f78585967397c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.709169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9e462beaa546ceb94f78585967397c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:05.711521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:05.798262 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] The token cache is being invalidate because project 041fbaa99bed422ea82ed42c8add9971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:05.809066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.809066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-984bfee2-8367-4810-a306-8923f09ddf55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.809066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1233/2451] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:05 2022] DELETE /identity/v3/projects/041fbaa99bed422ea82ed42c8add9971 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:05.812501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd588-c81f-47ee-a451-0965819dec93 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.812796 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd588-c81f-47ee-a451-0965819dec93 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.813080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bd588-c81f-47ee-a451-0965819dec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.834109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-da9bd588-c81f-47ee-a451-0965819dec93 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:05.835357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-da9bd588-c81f-47ee-a451-0965819dec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:05.846688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1234/2452] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:05.856049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.856344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.856627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.871227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9e462beaa546ceb94f78585967397c', 'request_id': 'req-f256b520-95c3-470e-ade8-06572596aadf'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.879075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9e462beaa546ceb94f78585967397c', 'request_id': 'req-f256b520-95c3-470e-ade8-06572596aadf'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.880734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:05.882120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:05.886016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9e462beaa546ceb94f78585967397c', 'request_id': 'req-f256b520-95c3-470e-ade8-06572596aadf'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.944270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1235/2453] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:05.948204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:05.958217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc2c71-be2e-443d-8d45-2df93ec7ca9c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:05.962924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:05.963872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.964142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.964419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.965155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:05.965590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:05.967525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:05.971022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] The token cache is being invalidate because project bd9e462beaa546ceb94f78585967397c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:05.972342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.972342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f256b520-95c3-470e-ade8-06572596aadf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:05.974040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1219/2454] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:05 2022] DELETE /identity/v3/projects/bd9e462beaa546ceb94f78585967397c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:05.978693 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b10e3-abfb-4151-887d-1c5faf587363 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:05.978979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b10e3-abfb-4151-887d-1c5faf587363 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:05.979436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47b10e3-abfb-4151-887d-1c5faf587363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:05.985501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1236/2455] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:05.987653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:05.991398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.001066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c47b10e3-abfb-4151-887d-1c5faf587363 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:06.001066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c47b10e3-abfb-4151-887d-1c5faf587363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.008572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1818b7-f814-40ac-8a2b-c0ea2657baa2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.009227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1220/2456] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:06.014202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.014858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.015146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.015421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.016105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.017984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.018474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.019324 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.019724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.040018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:06.041235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.049951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1221/2457] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:06.054136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.063968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c657d-fa86-4de7-b2d0-dff014c7d07e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.068798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.069487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.069768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.070098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.071127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:06.071593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.073460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.086837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1222/2458] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:40:06.092832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.102385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfce4ea-f3f9-460a-b89c-6c827ecf67e8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.108028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.116295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.116295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.116295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.116295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.116665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1237/2459] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:05 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:06.116758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.117191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.180798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97241a-8fe9-42ee-98e6-985ad273ba4e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.186031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.186726 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.187019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.187289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.187979 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.224397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.268388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1223/2460] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:06.272203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.308451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1238/2461] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:06.313624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.324110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2eeb-16fa-4499-9dd3-71d751c36791 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.338077 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540d95e-815d-4c7d-8d21-d3acd61fb3c8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.343584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.344259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.344570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.344855 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.345610 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.347656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.376331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:06.384843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.385548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.385881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.386137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.386859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.388604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.398141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1239/2462] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:06.402284 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.412982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd89ceb-8559-4166-89bb-58495273e846 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.417723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.418370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.419198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.419683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.420652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.422398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.432419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1240/2463] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:06.438198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.448895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeed80-7ea7-4291-9119-8199fbd1ce7c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.454065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.455041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.455334 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.455647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] PATH_INFO: `/v3/projects/efe56644ffcd4f9b88884a25dbed3380/users/c34f106715d44d809c31f4c23e0d371e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.474282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efe56644ffcd4f9b88884a25dbed3380, user_id=c34f106715d44d809c31f4c23e0d371e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.476547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1224/2464] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:06.476971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbad66b-f8a1-47e7-8e42-e3ec7b3e1c29 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.479200 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.489820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79900c-b369-4abe-992f-95bf5f8e86fe admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.495637 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.496287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.496622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.497690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.498419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.500022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.510261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1225/2465] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:06.514412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.525491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75f06d7-b8fc-4649-bd91-4ec78ee73e9c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.530425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.531100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.531384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.531667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.538669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.538669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.546532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1226/2466] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:06.550142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.560751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e4069-b1cd-488f-9b91-1ec3907701e9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.567801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1241/2467] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:06 2022] PUT /identity/v3/projects/efe56644ffcd4f9b88884a25dbed3380/users/c34f106715d44d809c31f4c23e0d371e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:06.579618 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.579920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.580510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.611639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] MFA Rules not processed for user `c34f106715d44d809c31f4c23e0d371e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:06.612976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.633731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.638164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.638164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.638164 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] PATH_INFO: `/v3/projects/768052d3698e483584138b97ac418580/users/1136b22863db49eba41ea8dfded8c750/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.651907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=768052d3698e483584138b97ac418580, user_id=1136b22863db49eba41ea8dfded8c750, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.654995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e5d48-eaa5-4924-9c9c-993f9769be0b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.685885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1242/2468] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:06.690391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.701494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dde7ba-ba4a-44a6-8770-b25aa83560bf None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.706210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.709656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.709656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.709656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.709656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.710166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.738139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1227/2469] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:06 2022] PUT /identity/v3/projects/768052d3698e483584138b97ac418580/users/1136b22863db49eba41ea8dfded8c750/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:06.742082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.742373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.742682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.759560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:06.760745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.828119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1228/2470] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:06.832867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1243/2471] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:06.838639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.841906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:06.843739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:06.849429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74528d-2986-47e6-8951-ddf58b23b5d3 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.908809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4c9f0-7d33-4f2a-afa9-f5c10a827391 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:06.912968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.915276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.915276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.915489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:06.915603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.915707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:06.915707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:06.915707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:06.916091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.918066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.932767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:06.935057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:06.949305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1244/2472] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:07.048692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1229/2473] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:06 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:07.051159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.061807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c6c5d-1388-4632-9599-cfdffb4e3ac7 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.074321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.075896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.076275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.076617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.077425 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:07.086701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:07.093516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1245/2474] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:07.098178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.114137 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5fa085-958f-41db-88c9-4cb1f4941776 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.122204 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.128446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.128446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.128446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] PATH_INFO: `/v3/projects/b5be2481c88a4ddb878795d50c0a8244/users/7d848e4952b94ad996f01e7770733e2e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.142773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be2481c88a4ddb878795d50c0a8244, user_id=7d848e4952b94ad996f01e7770733e2e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:07.146271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:07.243595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:07.249728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1230/2475] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:07 2022] PUT /identity/v3/projects/b5be2481c88a4ddb878795d50c0a8244/users/7d848e4952b94ad996f01e7770733e2e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:07.253738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.265066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4c1c7-6186-475a-95f6-713d299a05c5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.331424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.331424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.331647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.331876 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.332610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:07.334291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69695eeb-9e1c-4afe-9600-eb050089abc9 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:07.347509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1246/2476] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:07.351723 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.362943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ed9f79-06f9-489a-9f30-dff1a5f23dfb admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.367614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.368484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.369102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.369102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] PATH_INFO: `/v3/projects/b5be2481c88a4ddb878795d50c0a8244/users/7d848e4952b94ad996f01e7770733e2e/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.371025 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5be2481c88a4ddb878795d50c0a8244, user_id=7d848e4952b94ad996f01e7770733e2e, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:07.373985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:07.384252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1231/2477] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:07 2022] PUT /identity/v3/projects/b5be2481c88a4ddb878795d50c0a8244/users/7d848e4952b94ad996f01e7770733e2e/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:07.395140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.395435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.395734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.422119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] MFA Rules not processed for user `7d848e4952b94ad996f01e7770733e2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:07.423326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:07.518188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1247/2478] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:07.518794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:07.600439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.602251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:07.669954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37161984-efb1-4851-8bfd-40519322f040 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.673623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.676585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.676585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.676585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:07.683729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:07.685906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:07.695249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1232/2479] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:07.930640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:07.944175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179754e-a4f3-4043-a4c2-aba99f239c13 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:07.947858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:07.948644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:07.948929 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:07.949375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:08.007059 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:08.008667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9d66b-5e7f-4d02-b870-683d1a06efac service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:08.019360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1248/2480] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:08.033567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:08.034985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:08.111670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d81a02-4f1c-4d96-8092-baa6ee695dba service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:08.118311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:08.119313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:08.119561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:08.119831 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] PATH_INFO: `/v3/users/66ae41bb64db4c24abbfee5c97b90d20` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:08.121119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66ae41bb64db4c24abbfee5c97b90d20)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:08.123577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:08.473242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66ae41bb64db4c24abbfee5c97b90d20'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:08.474408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66ae41bb64db4c24abbfee5c97b90d20'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:08.487539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66ae41bb64db4c24abbfee5c97b90d20'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:08.603379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66ae41bb64db4c24abbfee5c97b90d20'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:08.603991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66ae41bb64db4c24abbfee5c97b90d20'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:08.624663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1233/2481] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:08 2022] DELETE /identity/v3/users/66ae41bb64db4c24abbfee5c97b90d20 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:08.629350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:08.629605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:08.629889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:08.649723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:08.650960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:08.717774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1249/2482] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:08.725549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:08.727428 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:08.807108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2be27-e04b-465b-accb-fd8464fb0564 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:08.811344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:08.812084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:08.812439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:08.812946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:08.828463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:08.830651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:08.845902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1234/2483] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:09.616442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:09.618670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:09.636610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8cf13-614d-4b7e-93c9-e31028079571 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:09.644218 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:09.656016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:09.656016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:09.656016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] PATH_INFO: `/v3/projects/9a1f6e51f01348c1b4c4d52bdbb3f80f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:09.656016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a1f6e51f01348c1b4c4d52bdbb3f80f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:09.659114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:09.800675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a1f6e51f01348c1b4c4d52bdbb3f80f', 'request_id': 'req-e5ae03bd-f90a-4fee-8727-09d66faf5e78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:09.816931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a1f6e51f01348c1b4c4d52bdbb3f80f', 'request_id': 'req-e5ae03bd-f90a-4fee-8727-09d66faf5e78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:09.832225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a1f6e51f01348c1b4c4d52bdbb3f80f', 'request_id': 'req-e5ae03bd-f90a-4fee-8727-09d66faf5e78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:09.940594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] The token cache is being invalidate because project 9a1f6e51f01348c1b4c4d52bdbb3f80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:09.940826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:09.941685 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e5ae03bd-f90a-4fee-8727-09d66faf5e78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:09.943274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1250/2484] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:09 2022] DELETE /identity/v3/projects/9a1f6e51f01348c1b4c4d52bdbb3f80f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:09.948141 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:09.992389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a5e-2533-4c1b-91be-6633166a76f0 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:10.135347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:10.135347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:10.135347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:10.135347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] PATH_INFO: `/v3/users/60c2341985e94f07a301feeef20b27a4` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:10.135688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c2341985e94f07a301feeef20b27a4)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:10.136218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:10.157414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:10.469642 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c2341985e94f07a301feeef20b27a4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:10.470740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c2341985e94f07a301feeef20b27a4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:10.494299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c2341985e94f07a301feeef20b27a4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:10.585893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c2341985e94f07a301feeef20b27a4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:10.586533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c2341985e94f07a301feeef20b27a4'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:10.602092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1235/2485] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:09 2022] DELETE /identity/v3/users/60c2341985e94f07a301feeef20b27a4 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:10.678711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:10.685689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:10.685689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:10.699162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:10.701937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:10.703988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:10.777528 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1251/2486] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:10.800947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:10.802804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:10.954262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f984a-e19f-4ec4-a83a-d114d7f7ba2e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:10.975788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:10.975788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:10.975788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:10.975788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:10.984793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:10.987773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e841608-30d0-4521-bd00-b645a7791146 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:10.999173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1236/2487] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:11.248894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.249025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.262362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6201dc8-738f-43d9-a818-d84a69310220 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.268034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.269058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.269620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.270068 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] PATH_INFO: `/v3/projects/7a50d96ac5594de98f552c88b7fc3cba` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.271423 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a50d96ac5594de98f552c88b7fc3cba)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.275577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.416798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a50d96ac5594de98f552c88b7fc3cba', 'request_id': 'req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.425215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a50d96ac5594de98f552c88b7fc3cba', 'request_id': 'req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.432252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a50d96ac5594de98f552c88b7fc3cba', 'request_id': 'req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.507966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] The token cache is being invalidate because project 7a50d96ac5594de98f552c88b7fc3cba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:11.508507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.513197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.513197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1252/2488] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:11 2022] DELETE /identity/v3/projects/7a50d96ac5594de98f552c88b7fc3cba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:11.516964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee06-1679-4c1b-aabe-88626ee98b60 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.517634 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee06-1679-4c1b-aabe-88626ee98b60 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.518190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62dee06-1679-4c1b-aabe-88626ee98b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.545062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b62dee06-1679-4c1b-aabe-88626ee98b60 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:11.546682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b62dee06-1679-4c1b-aabe-88626ee98b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.565840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.570809 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.635949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1237/2489] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:11.641585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.641585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.641585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.663239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:11.665059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:11.682116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1238/2490] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:11.687400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.694329 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9835f-d483-47a6-a5f2-db6ecbb8b564 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.702498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd307ac-822a-4494-b2c3-5ea23f8a8f07 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.702774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.703787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.704442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.704948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] PATH_INFO: `/v3/users/c34f106715d44d809c31f4c23e0d371e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.706875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34f106715d44d809c31f4c23e0d371e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.709369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.710002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.711302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.711595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.712300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.713705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:11.714191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.718231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.732539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1239/2491] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:40:11.736531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.747797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cc739-13d6-49d9-b4f1-1c6d6f21c946 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.753673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.754423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.754776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.755122 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.755894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:11.758230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:11.875080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1240/2492] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:11 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:11.879068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:11.919305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34f106715d44d809c31f4c23e0d371e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.958036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34f106715d44d809c31f4c23e0d371e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:11.988662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc58e4-aeae-4a72-8fb6-001e49768202 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:11.994746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:11.995724 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:11.996218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:11.997652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:11.998612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.001083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.061664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34f106715d44d809c31f4c23e0d371e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.062379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34f106715d44d809c31f4c23e0d371e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.062988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b83bf65-df24-4c69-8932-612d1cc501f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34f106715d44d809c31f4c23e0d371e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:12.078582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1253/2493] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:11 2022] DELETE /identity/v3/users/c34f106715d44d809c31f4c23e0d371e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:12.083585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.085018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.085018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.107382 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.110869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.245991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1241/2494] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:11 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:12.251000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.254846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.261137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1254/2495] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:12.276567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40018941-5ddc-4d9e-993d-a36fa15060c7 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.279909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.281605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.305240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.328922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.328922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.328922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.328922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.328922 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.345295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1242/2496] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:12.349491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.371552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796e7fc-1784-476b-b033-11ddfe0efbc4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.378049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.378987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.379276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.379557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.394010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.394010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.453298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1243/2497] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:12.453298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.472175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc77f2-f1b3-4abf-a953-ade7c2ec5081 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.478732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274a6c9-b638-4532-bc78-dccbb8e73f0e None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:12.483961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.487159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.487454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.487738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.487901 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:12.489086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.493251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.495236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] PATH_INFO: `/v3/projects/ca0ecb9adba44560902dc2bd3d5b264c/users/0a764518c42f42bfa0c3025ae59b35d7/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.516605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0ecb9adba44560902dc2bd3d5b264c, user_id=0a764518c42f42bfa0c3025ae59b35d7, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.519643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243f6c-953f-441f-b529-5e76e6df307f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.534287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:12.535764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55320d-e4c9-44d3-ab14-322307ecc046 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:12.596989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1244/2498] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:12 2022] PUT /identity/v3/projects/ca0ecb9adba44560902dc2bd3d5b264c/users/0a764518c42f42bfa0c3025ae59b35d7/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:12.600671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1255/2499] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:12.608598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.609029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.609538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.718853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] MFA Rules not processed for user `0a764518c42f42bfa0c3025ae59b35d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.722441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.854173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:12.855056 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:12.855491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:12.906535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] MFA Rules not processed for user `eaf9c9fd3a5d4791907748df8bad800c`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:12.907997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:12.945507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1245/2500] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:12.967379 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:12.969302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:13.010448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1256/2501] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:13.040083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab449f-a5c9-4f8d-bebd-63ac758d001f None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:13.046585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:13.046585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:13.048009 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:13.051078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:13.071076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:13.073314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:13.087596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1246/2502] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:13.193622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:13.571859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:14.119344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:14.121656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:14.214277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a9f0f5-0166-423b-8fe7-a0a60af93dff None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:14.219392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:14.220453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:14.223295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:14.223295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] PATH_INFO: `/v3/projects/efe56644ffcd4f9b88884a25dbed3380` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:14.223295 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=efe56644ffcd4f9b88884a25dbed3380)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:14.224346 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:14.422691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efe56644ffcd4f9b88884a25dbed3380', 'request_id': 'req-efcfda21-0d66-48ce-ade4-b04a129a8beb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:14.438517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efe56644ffcd4f9b88884a25dbed3380', 'request_id': 'req-efcfda21-0d66-48ce-ade4-b04a129a8beb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:14.452636 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efe56644ffcd4f9b88884a25dbed3380', 'request_id': 'req-efcfda21-0d66-48ce-ade4-b04a129a8beb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:14.551539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] The token cache is being invalidate because project efe56644ffcd4f9b88884a25dbed3380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:14.551831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:14.552632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-efcfda21-0d66-48ce-ade4-b04a129a8beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:14.560392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1257/2503] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:14 2022] DELETE /identity/v3/projects/efe56644ffcd4f9b88884a25dbed3380 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:14.568026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:14.581043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4a89ce-6472-47b1-bcaa-1d9954f61f9a service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:14.721860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:14.722905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:14.723288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:14.723671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] PATH_INFO: `/v3/users/7d848e4952b94ad996f01e7770733e2e` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:14.725667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d848e4952b94ad996f01e7770733e2e)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:14.728003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:15.013071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d848e4952b94ad996f01e7770733e2e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:15.014159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d848e4952b94ad996f01e7770733e2e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:15.053375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d848e4952b94ad996f01e7770733e2e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:15.174267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d848e4952b94ad996f01e7770733e2e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:15.178171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-939b602b-8fb5-4de4-9d55-f4d3a9aab02f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d848e4952b94ad996f01e7770733e2e'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:15.204856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1247/2504] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:14 2022] DELETE /identity/v3/users/7d848e4952b94ad996f01e7770733e2e => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:15.527328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:15.528731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:15.530643 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:15.538576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:15.539178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:15.539818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:15.599095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] MFA Rules not processed for user `1136b22863db49eba41ea8dfded8c750`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:15.601287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.603076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:15.610172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.723092 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1258/2505] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:15.744614 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1248/2506] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:15.744834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:15.747199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.749910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:15.752245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.771191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e572b4-7b3a-44e8-9186-ecfc56cab6c7 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:15.777351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:15.778188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:15.778482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:15.778869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:15.779704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:15.781739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:15.850751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c994e-5d83-4f7a-865f-c0aca6e66000 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:15.858286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:15.859050 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:15.859342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:15.859647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:15.869422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:15.871213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:15.888898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1249/2507] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:15 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:15.889972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:15.903341 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:15.904250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1259/2508] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:15.905380 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:15.921241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83734ba-6133-4641-93f9-dda56b492df9 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.042152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.044945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.046289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.046669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.047892 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.057802 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:16.057909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.084177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e796d8-1bd9-48d4-a894-ef643e5058ba admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.100322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.101280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.101557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.101830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] PATH_INFO: `/v3/projects/b5be2481c88a4ddb878795d50c0a8244` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.103163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5be2481c88a4ddb878795d50c0a8244)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.105344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.223205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1260/2509] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:15 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:16.226828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.240850 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7014fc-e263-4545-8d91-0d62c4e49b1e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.244296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5be2481c88a4ddb878795d50c0a8244', 'request_id': 'req-c7e4ae06-f351-48a4-b70b-e18ef36f9541'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:16.252087 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5be2481c88a4ddb878795d50c0a8244', 'request_id': 'req-c7e4ae06-f351-48a4-b70b-e18ef36f9541'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:16.258461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5be2481c88a4ddb878795d50c0a8244', 'request_id': 'req-c7e4ae06-f351-48a4-b70b-e18ef36f9541'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:16.306202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.306992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.307356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.307948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.308549 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.311508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.324148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1261/2510] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:16.328540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.339232 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434904e8-7fb0-4847-acff-0521092e11dc admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.357645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] The token cache is being invalidate because project b5be2481c88a4ddb878795d50c0a8244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:16.357645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:16.357645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-c7e4ae06-f351-48a4-b70b-e18ef36f9541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:16.357863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.357863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.357863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.357863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] PATH_INFO: `/v3/projects/4fd0b44fe4bd4a61a8976812b353af93/users/f21319d8a0b542ceade2e4e3a8eb0f87/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.376566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1250/2511] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:15 2022] DELETE /identity/v3/projects/b5be2481c88a4ddb878795d50c0a8244 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:16.381436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6838c2-c47c-4edb-8f40-f32cd845788f None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.381844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6838c2-c47c-4edb-8f40-f32cd845788f None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.382228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6838c2-c47c-4edb-8f40-f32cd845788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.394147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0b44fe4bd4a61a8976812b353af93, user_id=f21319d8a0b542ceade2e4e3a8eb0f87, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.394464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.419989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1c6838c2-c47c-4edb-8f40-f32cd845788f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:16.423506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1c6838c2-c47c-4edb-8f40-f32cd845788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:16.441388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1251/2512] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:16.448895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.454468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.454468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.468509 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:16.469820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:16.478752 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1252/2513] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:16.483478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.494085 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5e6cc-74fa-4be1-89e8-452a28a251f3 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.500811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.501710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.502308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.502735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.503615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:16.503927 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.505551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.522619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1253/2514] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:40:16.529663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.540619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1262/2515] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:16 2022] PUT /identity/v3/projects/4fd0b44fe4bd4a61a8976812b353af93/users/f21319d8a0b542ceade2e4e3a8eb0f87/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:16.542178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.544666 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:16.548583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:16.555195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da367364-6c03-450c-82e0-e18010bf72fd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.615567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.617010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.617537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.617977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.618846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.620931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.622464 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186c7d1-1a6e-457a-8786-90f177fb63ca admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.627341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.628015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.628301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.628577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.629341 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.630933 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.645502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1263/2516] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:16.646931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.657983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a0ad2-94b5-47f3-ab43-2524ceec31d1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.662928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.663817 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.664132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.664413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] PATH_INFO: `/v3/projects/4fd0b44fe4bd4a61a8976812b353af93/users/f21319d8a0b542ceade2e4e3a8eb0f87/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.666460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd0b44fe4bd4a61a8976812b353af93, user_id=f21319d8a0b542ceade2e4e3a8eb0f87, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.669215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:16.680463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1264/2517] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:16 2022] PUT /identity/v3/projects/4fd0b44fe4bd4a61a8976812b353af93/users/f21319d8a0b542ceade2e4e3a8eb0f87/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:16.775832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1254/2518] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:16 2022] POST /identity/v3/projects => generated 371 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:16.777117 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:16.868978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7ed82-2260-41e4-b446-f858abe49a62 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:16.914727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:16.944999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:16.945954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:16.946107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:16.946384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:16.947089 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:16.949123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:17.160114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1265/2519] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:16 2022] POST /identity/v3/users => generated 286 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:17.166090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:17.185445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3e3a7-4cbe-4f11-b2a4-a40a6197c0b5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:17.191251 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:17.192544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:17.198664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:17.198664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:17.198664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:17.198664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:17.213778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1255/2520] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:40:17.216350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:17.242200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188d492-add2-42df-b317-db0dc3581c0a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:17.255288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:17.256192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:17.256487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:17.256772 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:17.257555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:17.259185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607c2be-95a9-443b-9b50-f83b17fc1ec3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:17.275998 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1266/2521] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:17.280733 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:17.292994 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009564e2-3a1c-4704-890f-5a6b0cac789c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:17.298328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:17.299225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:17.299506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:17.299959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] PATH_INFO: `/v3/projects/3401c848ca364701931a0be12510c4f3/users/2e94ea26fb77479aa3cf357f135c1f6b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:17.320295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3401c848ca364701931a0be12510c4f3, user_id=2e94ea26fb77479aa3cf357f135c1f6b, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:17.320681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:17.446479 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1256/2522] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:17 2022] PUT /identity/v3/projects/3401c848ca364701931a0be12510c4f3/users/2e94ea26fb77479aa3cf357f135c1f6b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:17.452961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37361-2a81-4f40-b175-e17e391e121d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:17.453205 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37361-2a81-4f40-b175-e17e391e121d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:17.453542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d37361-2a81-4f40-b175-e17e391e121d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:17.476444 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e9d37361-2a81-4f40-b175-e17e391e121d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:17.477798 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e9d37361-2a81-4f40-b175-e17e391e121d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:17.562018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1267/2523] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:17.583013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:17.583013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:17.653867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aef4c8-940f-407f-8c59-731779a6c1c5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:17.658078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:17.658748 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:17.659036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:17.659348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:17.680283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:17.682042 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:17.721217 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1257/2524] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:19.975363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:19.975819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:19.975901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.018808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:20.025754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] MFA Rules not processed for user `2e94ea26fb77479aa3cf357f135c1f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:20.027001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:20.169724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1268/2525] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:20.183352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:20.186134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:20.394545 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:20.454954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19eebf-0217-4385-965d-dee2323f8620 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:20.469362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:20.470219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:20.470558 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:20.471526 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.489338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:20.491014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8aba5-e095-4790-bc9c-f9ccc076b6c5 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:20.510887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1258/2526] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:20.921985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:20.923815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:20.958641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9e700-3cac-4288-9c08-c74b2344493f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:20.975804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:20.977484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:20.977786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:20.978071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] PATH_INFO: `/v3/users/f63f21a56c5b487b8229b69256c3edda` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:20.984522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63f21a56c5b487b8229b69256c3edda)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:20.988867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.405299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63f21a56c5b487b8229b69256c3edda'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.422731 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63f21a56c5b487b8229b69256c3edda'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.518947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63f21a56c5b487b8229b69256c3edda'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.519589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63f21a56c5b487b8229b69256c3edda'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.520206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ebe76f57-1fe4-4d81-a56a-4995ca5a2c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63f21a56c5b487b8229b69256c3edda'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:21.550639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1269/2527] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:20 2022] DELETE /identity/v3/users/f63f21a56c5b487b8229b69256c3edda => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:21.556423 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.557319 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.560830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.583829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:21.585793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.627633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.627918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.628370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.661562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:21.662981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.708388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1259/2528] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:21.722288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.724239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.819622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1270/2529] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:21.847747 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:21.849215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:21.869355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e3fd3b-60cd-4bda-9bfa-6b5f09717ffd None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:21.882460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:21.883342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:21.890102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:21.890102 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:21.919417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:21.922881 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6be08f-ecdb-4905-aabc-9f78ddf5d370 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:21.946784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1260/2530] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:22.028363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cf5c-72e4-401c-bf77-0bbfed9b6179 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:22.034905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:22.035564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:22.036042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:22.036615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:22.046409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:22.048011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:22.061475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1271/2531] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:22.592990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:22.820111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8271-c3f0-4926-8ffb-4e5d11b23015 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:22.820612 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8271-c3f0-4926-8ffb-4e5d11b23015 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:22.820698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf8271-c3f0-4926-8ffb-4e5d11b23015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:22.841307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-babf8271-c3f0-4926-8ffb-4e5d11b23015 None None] MFA Rules not processed for user `2e94ea26fb77479aa3cf357f135c1f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:22.842849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-babf8271-c3f0-4926-8ffb-4e5d11b23015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:22.886602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:22.889788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:22.913764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d9b85-0a8d-4232-95fa-38495ca2ac11 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:22.931091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:22.932720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:22.933030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:22.933391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] PATH_INFO: `/v3/projects/ee6570b6008c48619ea9c0f9a7ad22f3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:22.933520 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1261/2532] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:22.934936 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6570b6008c48619ea9c0f9a7ad22f3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:22.936843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.070026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6570b6008c48619ea9c0f9a7ad22f3', 'request_id': 'req-96ec9c80-2576-4a52-99a6-b6913bbe0096'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:23.083964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6570b6008c48619ea9c0f9a7ad22f3', 'request_id': 'req-96ec9c80-2576-4a52-99a6-b6913bbe0096'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:23.091967 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6570b6008c48619ea9c0f9a7ad22f3', 'request_id': 'req-96ec9c80-2576-4a52-99a6-b6913bbe0096'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:23.130710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:23.181502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] The token cache is being invalidate because project ee6570b6008c48619ea9c0f9a7ad22f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:23.181791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:23.182954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-96ec9c80-2576-4a52-99a6-b6913bbe0096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:23.186182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1272/2533] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:22 2022] DELETE /identity/v3/projects/ee6570b6008c48619ea9c0f9a7ad22f3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:40:23.191801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.192095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.192398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.222198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:23.223594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:23.308454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.308855 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.309493 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.315503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1262/2534] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:23.331489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:23.332628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:23.345091 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1273/2535] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:23.347970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.361210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66427e68-1d2f-40e9-9810-4e16b37ec24e None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.367429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.368362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.368956 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.369456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.370863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:40:23.371763 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.374326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.399078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1263/2536] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:40:23.405537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.416692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004de92-a807-4906-b4f8-9689d203bacc None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.423564 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.424519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.425076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.425487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.427155 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.429706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.601037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1274/2537] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:40:23 2022] POST /identity/v3/projects => generated 399 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:40:23.605414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.615860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c11a07b-b1f0-4e35-9139-b0dad8dc5ffd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.727796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.728216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.728969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.728969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.729815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.733051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.858163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1264/2538] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:40:23 2022] POST /identity/v3/users => generated 300 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:40:23.864424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.881419 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3828fee-492d-4b86-bc95-97a80de0439d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.891466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.892534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.894028 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.895007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.897948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.900448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.914732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1275/2539] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:23.919295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.933180 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93c10a-3f25-4823-aad9-8a602c9ddefd admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.939576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.940548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.940987 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.941494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:23.942578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:23.944309 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d112d-d9d5-4dc9-800d-28eb863358ab admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:23.956989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1265/2540] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:40:23.962079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:23.974504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c1062-923f-474b-8ce8-f1cdb069da82 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:23.994049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:23.995436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:23.996078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:23.996723 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] PATH_INFO: `/v3/projects/b5b346d662aa4c24b68e9670ec88a417/users/80d30a1f1ecb423ba55c7822b5fa65b6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.030924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b346d662aa4c24b68e9670ec88a417, user_id=80d30a1f1ecb423ba55c7822b5fa65b6, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:24.040151 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:24.157309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1276/2541] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:40:23 2022] PUT /identity/v3/projects/b5b346d662aa4c24b68e9670ec88a417/users/80d30a1f1ecb423ba55c7822b5fa65b6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:24.168375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aacb9e-392c-4ef6-a8e4-d4e82e3e43e8 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:24.168762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aacb9e-392c-4ef6-a8e4-d4e82e3e43e8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:24.169041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aacb9e-392c-4ef6-a8e4-d4e82e3e43e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.211826 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-d7aacb9e-392c-4ef6-a8e4-d4e82e3e43e8 None None] MFA Rules not processed for user `80d30a1f1ecb423ba55c7822b5fa65b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:24.213065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d7aacb9e-392c-4ef6-a8e4-d4e82e3e43e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:24.300918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1266/2542] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:24.315932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:24.318744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:24.382203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d8af2-65c5-42a0-b677-a3ad22c3d661 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:24.385854 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:24.386507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:24.390340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:24.390340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:24.397220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:24.398727 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:24.409617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1277/2543] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:25.299861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4e5e3-c67a-427c-a675-bb156982f56c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:25.300306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4e5e3-c67a-427c-a675-bb156982f56c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:25.300495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4e5e3-c67a-427c-a675-bb156982f56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:25.334818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bee4e5e3-c67a-427c-a675-bb156982f56c None None] MFA Rules not processed for user `f21319d8a0b542ceade2e4e3a8eb0f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:25.334818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bee4e5e3-c67a-427c-a675-bb156982f56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:25.413466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1267/2544] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:25.427200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:25.428757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:25.515333 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88f8cb2-e7cc-4eab-b20a-01c7889f69e4 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:25.522626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:25.523566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:25.523925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:25.524275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:25.530110 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:25.618122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:25.620134 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:25.635241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1278/2545] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:26.216427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:26.474797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e7bb-64d8-4664-be12-1896c4bce772 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:26.475338 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e7bb-64d8-4664-be12-1896c4bce772 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:26.475422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7e7bb-64d8-4664-be12-1896c4bce772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:26.497387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e2f7e7bb-64d8-4664-be12-1896c4bce772 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:26.499146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e2f7e7bb-64d8-4664-be12-1896c4bce772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:26.575951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1268/2546] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:26.596946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:26.598466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:26.614288 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f961719-df6a-49b6-9b8a-fcdca303cd8d service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:26.622366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:26.623312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:26.623754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:26.624323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:26.636053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:26.640312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a25c270-bf9c-4f52-9d09-90795d6b5bab service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:26.661474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1279/2547] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:27.037664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=8,keystone:SELECT=85,keystone:INSERT=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:28.639454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:29.281958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:29.282477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:29.282561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:29.302177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] MFA Rules not processed for user `1136b22863db49eba41ea8dfded8c750`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:29.303385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:29.311342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1269/2548] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:30.478327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:30.822340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:30.883494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:30.883494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:30.883494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:30.894689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:30.896715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:30.906614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1280/2549] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:30.942648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:30.956093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125577d9-49a4-4ebd-b7ab-06d83e5bbfa1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:30.961884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:30.962643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:30.962991 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:30.963275 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:30.973057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:30.975447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c93cd-53fe-41ec-9b65-4bd2589e6245 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:30.984970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1270/2550] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:31.156866 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:31.167043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341606d0-7739-4a04-ba16-117ba96aea91 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:31.172331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:31.173202 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:31.173520 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:31.173799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] PATH_INFO: `/v3/users/80d30a1f1ecb423ba55c7822b5fa65b6` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:31.175025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d30a1f1ecb423ba55c7822b5fa65b6)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:31.176974 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:31.504594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d30a1f1ecb423ba55c7822b5fa65b6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:31.517713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d30a1f1ecb423ba55c7822b5fa65b6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:31.628128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d30a1f1ecb423ba55c7822b5fa65b6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:31.628955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d30a1f1ecb423ba55c7822b5fa65b6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:31.629848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d30a1f1ecb423ba55c7822b5fa65b6'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:31.645013 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1281/2551] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:40:31 2022] DELETE /identity/v3/users/80d30a1f1ecb423ba55c7822b5fa65b6 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:31.649792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:31.650281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:31.650375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:31.668984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:31.670397 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:31.731276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1271/2552] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:40:31.741233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:31.742667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:31.803617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89118-b8c4-41da-a7ca-08537b4bac00 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:31.807167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:31.807811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:31.808099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:31.808474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:31.817544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:31.819724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e97c46-9fc1-4ea4-a9c0-67b0ad6faf4a service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:31.829301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1282/2553] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:40:31.838958 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:32.337320 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:32.339964 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:32.358725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c54e4a-c252-4266-a173-c91919788b49 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:32.365938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:32.367143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:32.367630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:32.368266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] PATH_INFO: `/v3/projects/b5b346d662aa4c24b68e9670ec88a417` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:32.370079 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b346d662aa4c24b68e9670ec88a417)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:32.373645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:32.498780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b346d662aa4c24b68e9670ec88a417', 'request_id': 'req-7826a960-2862-4066-a84d-a674d866fb78'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:32.514126 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b346d662aa4c24b68e9670ec88a417', 'request_id': 'req-7826a960-2862-4066-a84d-a674d866fb78'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:32.535876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b346d662aa4c24b68e9670ec88a417', 'request_id': 'req-7826a960-2862-4066-a84d-a674d866fb78'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:32.626419 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] The token cache is being invalidate because project b5b346d662aa4c24b68e9670ec88a417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:40:32.626708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:32.627545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:40:32.629649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1272/2554] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:40:32 2022] DELETE /identity/v3/projects/b5b346d662aa4c24b68e9670ec88a417 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:40:32.944130 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:33.702153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:34.102035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:34.874277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:35.198849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4285-388b-48dd-8e0a-fe6d052729ad None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:35.199287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4285-388b-48dd-8e0a-fe6d052729ad None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:35.199679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f4285-388b-48dd-8e0a-fe6d052729ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:35.219131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-933f4285-388b-48dd-8e0a-fe6d052729ad None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:35.220328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-933f4285-388b-48dd-8e0a-fe6d052729ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:35.283415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1283/2555] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:35.303281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:40:35.305220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:35.398311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826a960-2862-4066-a84d-a674d866fb78 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:40:35.403502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:40:35.404188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:35.404474 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:35.404753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:35.415071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:40:35.416690 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b7b5de-3cf6-4917-8d44-f2af1f1cac4f service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:40:35.432283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1273/2556] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:40:36.014553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:36.301655 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:37.489671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=87,keystone:INSERT=7,keystone:DELETE=6 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:37.741783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:38.279129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:39.747913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:39.900435 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:41.159241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:41.318879 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:41.661730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:41.781988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:42.479044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:42.627799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:42.768930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:43.072869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:43.154727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:43.793763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:43.821731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:44.363883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:44.462554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:45.135964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:45.170582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:45.615785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:45.861560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.010584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.135914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.163072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.410521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.460394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.570414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.627661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.742035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:46.913593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.078995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.210443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.335750 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.421642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.507838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.616147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.650770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.787648 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:47.821725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.112946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.164529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.377954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.393227 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.478939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.496223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=79,keystone:INSERT=7,keystone:DELETE=14 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.593308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.633518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.799091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.828054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.918893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:48.952282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.038718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.067120 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.171078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.217318 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.353279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.393374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.633361 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.678689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.833139 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:49.867318 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.078623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.223358 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.249076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.336388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.397546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.427679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.483528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.514315 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.627653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.655923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.684187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.838906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:50.871940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.004859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.039086 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.227206 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.261640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.416121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.451134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.553480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.656292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.724630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.810495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:51.838800 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.027443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.089027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.306265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.335106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.689455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:52.902104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:INSERT=8 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:53.068349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:53.702439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:53.776036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:53.913234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:54.244494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:54.342357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:54.616340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:54.884725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.193129 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.254755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.502710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.765629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.884227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.910367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:55.918405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:55.918694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:55.919024 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:55.936568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] MFA Rules not processed for user `2e94ea26fb77479aa3cf357f135c1f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:55.938060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:55.993752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1284/2557] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:40:56.234602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:56.261540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:56.571477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:56.615379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:57.004525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:57.364771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:57.560162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:58.108183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:58.563323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:58.690199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:58.883809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:40:59.560837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a534f-17a1-476d-8b3f-3abd141c201c None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:40:59.561175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a534f-17a1-476d-8b3f-3abd141c201c None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:40:59.561443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a534f-17a1-476d-8b3f-3abd141c201c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:40:59.581071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-981a534f-17a1-476d-8b3f-3abd141c201c None None] MFA Rules not processed for user `2fe22b57fdec43aba874cc1589e84e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:40:59.584982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-981a534f-17a1-476d-8b3f-3abd141c201c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:40:59.648177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1274/2558] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:04.033185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.034680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:04.049613 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d84bcb-c210-4aa9-a5fc-c76e12aeb52a None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.054587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.055785 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.056076 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.056357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] PATH_INFO: `/v3/users/0a764518c42f42bfa0c3025ae59b35d7` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.057680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a764518c42f42bfa0c3025ae59b35d7)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.059693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.253670 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:04.259046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a764518c42f42bfa0c3025ae59b35d7'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:04.273007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a764518c42f42bfa0c3025ae59b35d7'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:04.381431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a764518c42f42bfa0c3025ae59b35d7'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:04.381899 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a764518c42f42bfa0c3025ae59b35d7'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:04.383009 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a764518c42f42bfa0c3025ae59b35d7'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:04.398932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1285/2559] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:41:04 2022] DELETE /identity/v3/users/0a764518c42f42bfa0c3025ae59b35d7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:04.403310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.403834 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.403920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.424091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:04.425358 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:04.485977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1275/2560] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:04.495429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:04.496810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:04.559814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d269-c430-4eae-a6ab-839662fcd117 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:04.564393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:04.565054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:04.565379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:04.565659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:04.575884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:04.578200 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:04.591783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1286/2561] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:05.194936 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:05.197247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:05.222890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1e37-9169-40ac-a7a7-a70a86cdef63 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:05.235245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:05.235245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:05.235245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:05.235245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] PATH_INFO: `/v3/projects/ca0ecb9adba44560902dc2bd3d5b264c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:05.235557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0ecb9adba44560902dc2bd3d5b264c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:05.239272 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:05.269931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:05.383100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0ecb9adba44560902dc2bd3d5b264c', 'request_id': 'req-447977ef-1266-4482-9d78-c98ec3ff0b40'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:05.390928 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0ecb9adba44560902dc2bd3d5b264c', 'request_id': 'req-447977ef-1266-4482-9d78-c98ec3ff0b40'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:05.396735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0ecb9adba44560902dc2bd3d5b264c', 'request_id': 'req-447977ef-1266-4482-9d78-c98ec3ff0b40'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:05.460589 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] The token cache is being invalidate because project ca0ecb9adba44560902dc2bd3d5b264c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:05.463709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:05.464227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:05.466212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1276/2562] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:41:05 2022] DELETE /identity/v3/projects/ca0ecb9adba44560902dc2bd3d5b264c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:09.180410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:09.182037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:09.307740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f5250-cf18-4ed1-a583-77ddd90e8300 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:09.360399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:09.387279 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:09.387948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:09.388237 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:09.388524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:09.390961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:09.404126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:09.406040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76807b78-418c-4b55-b1d3-428034ef9db5 service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:09.418273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1287/2563] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:16.015388 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:16.017016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:16.081019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447977ef-1266-4482-9d78-c98ec3ff0b40 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:16.085643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:16.086294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:16.086578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:16.086856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:16.088650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:16.157351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:16.159034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:16.169860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1277/2564] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:19.615750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=12 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:20.840081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2aad5-470d-47b6-82df-49bbfa36c196 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:20.840674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2aad5-470d-47b6-82df-49bbfa36c196 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:20.840791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d2aad5-470d-47b6-82df-49bbfa36c196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:20.859603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b0d2aad5-470d-47b6-82df-49bbfa36c196 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:20.860821 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b0d2aad5-470d-47b6-82df-49bbfa36c196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:20.929489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1288/2565] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:20.946127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:20.948285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:21.004223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:21.028195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773958b5-1757-465b-a4d4-99b7f3dea818 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:21.034917 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:21.035573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:21.035867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:21.036226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:21.044737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:21.046372 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:21.056066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1278/2566] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:22.570638 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2bb3e-0bd1-4e7a-9e25-165209528ea1 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:22.571124 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2bb3e-0bd1-4e7a-9e25-165209528ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:22.571233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2bb3e-0bd1-4e7a-9e25-165209528ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:22.644238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-5ad2bb3e-0bd1-4e7a-9e25-165209528ea1 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:22.645550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5ad2bb3e-0bd1-4e7a-9e25-165209528ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:22.726216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1289/2567] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:41:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:22.772787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:22.774207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:22.867718 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa58ec-7acd-432f-a879-666a1c83be36 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:22.872912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:22.873675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:22.873974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:22.874285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:22.882580 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:22.884198 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:22.893435 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1279/2568] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:41:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:41:25.724986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695405-7b2d-464a-bdcb-c3f9e20a5727 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:25.725635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695405-7b2d-464a-bdcb-c3f9e20a5727 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:25.725738 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2695405-7b2d-464a-bdcb-c3f9e20a5727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:25.766455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e2695405-7b2d-464a-bdcb-c3f9e20a5727 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:25.766455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e2695405-7b2d-464a-bdcb-c3f9e20a5727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:25.783835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1290/2569] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:25.805884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:25.818181 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:25.838973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59004277-bce4-403e-85aa-9b222a986cc7 service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:25.851326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:25.852156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:25.852528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:25.852800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:25.863224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:25.864853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:25.875426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1280/2570] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:29.691646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116bb3a-38a1-4a15-af6f-5e7aa4e9e8f5 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:29.692576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116bb3a-38a1-4a15-af6f-5e7aa4e9e8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:29.692969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2116bb3a-38a1-4a15-af6f-5e7aa4e9e8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:29.714576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2116bb3a-38a1-4a15-af6f-5e7aa4e9e8f5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:29.715072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2116bb3a-38a1-4a15-af6f-5e7aa4e9e8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:29.724136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1291/2571] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:29.740125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:29.753195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f806a7-a82f-4390-b203-d0859e009819 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:29.759104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:29.759932 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:29.760216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:29.760490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:29.772429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:29.774069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:29.784824 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1281/2572] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:41:33.946246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368435b-a747-45c6-91ba-b66d034e32ea None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:33.946759 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368435b-a747-45c6-91ba-b66d034e32ea None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:33.946873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368435b-a747-45c6-91ba-b66d034e32ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:33.969628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c368435b-a747-45c6-91ba-b66d034e32ea None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:33.970877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c368435b-a747-45c6-91ba-b66d034e32ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:33.979000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1292/2573] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:33.996476 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:34.013183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44e5a8-2e54-4a7a-9d11-ad8efaaa321c service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:34.026351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:34.027017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:34.027301 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:34.027577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:34.037514 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:34.040592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:34.050380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1282/2574] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:38.285199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eb5e-0687-471b-93a8-31f2bea26202 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:38.285795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eb5e-0687-471b-93a8-31f2bea26202 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:38.285968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a5eb5e-0687-471b-93a8-31f2bea26202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:38.316508 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-78a5eb5e-0687-471b-93a8-31f2bea26202 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:38.317661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-78a5eb5e-0687-471b-93a8-31f2bea26202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:38.325626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1293/2575] 10.222.0.72 () {58 vars in 1016 bytes} [Fri May 27 03:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:38.339540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:38.352445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c92b11-cf80-4571-9c17-1bd24f3bebaf service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:38.359026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:38.359670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:38.359959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:38.360242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:38.372669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:38.372669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:38.382852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1283/2576] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:39.250895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:39.251025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:39.251275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:39.270863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:39.272075 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:39.279969 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1294/2577] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:41:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:41:39.295861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:39.307461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f09ac7-76cc-4126-87f0-6c119039720b service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:39.313313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:39.313977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:39.314262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:39.314540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:39.322679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:39.324240 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:39.332963 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1284/2578] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:41:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:41:42.343918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:42.345826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:42.364363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402743d2-be97-49f8-85b9-c76ecf96594c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:42.367783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:42.368703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:42.368986 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:42.369310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] PATH_INFO: `/v3/users/2e94ea26fb77479aa3cf357f135c1f6b` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:42.370625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e94ea26fb77479aa3cf357f135c1f6b)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:42.372682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:42.474582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:42.577307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e94ea26fb77479aa3cf357f135c1f6b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:42.588937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e94ea26fb77479aa3cf357f135c1f6b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:42.694820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e94ea26fb77479aa3cf357f135c1f6b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:42.695575 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e94ea26fb77479aa3cf357f135c1f6b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:42.696296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-e56990ca-3332-4505-9ee2-df503091517b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e94ea26fb77479aa3cf357f135c1f6b'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:42.715186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1295/2579] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:41:42 2022] DELETE /identity/v3/users/2e94ea26fb77479aa3cf357f135c1f6b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:43.011161 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.022851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c231e32-73a9-490c-bf1f-2923a31c350b service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.059567 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:43.083404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.084264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.084550 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.084829 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] PATH_INFO: `/v3/projects/3401c848ca364701931a0be12510c4f3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.086045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3401c848ca364701931a0be12510c4f3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.087915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.199915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3401c848ca364701931a0be12510c4f3', 'request_id': 'req-bd259061-0d09-4a90-b044-35acd4d44228'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:43.206276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3401c848ca364701931a0be12510c4f3', 'request_id': 'req-bd259061-0d09-4a90-b044-35acd4d44228'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:43.211796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3401c848ca364701931a0be12510c4f3', 'request_id': 'req-bd259061-0d09-4a90-b044-35acd4d44228'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:43.290074 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] The token cache is being invalidate because project 3401c848ca364701931a0be12510c4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:41:43.290415 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:43.291190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bd259061-0d09-4a90-b044-35acd4d44228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:41:43.292794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1285/2580] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:41:43 2022] DELETE /identity/v3/projects/3401c848ca364701931a0be12510c4f3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:43.298406 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.298702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.298991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.317951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:43.319166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:43.382639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1296/2581] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:43.390464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.390906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.391174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.410239 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:43.411437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:43.419335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1286/2582] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:43.423703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.433962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3fc43-7283-4946-9054-1c1cf673d28c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.439641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.440338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.440623 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.440900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.441665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:41:43.441975 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.443572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.457698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1297/2583] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:41:43.461348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.470951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0bd2f-af87-46a9-a216-d4b4d1e3f535 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.475639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.476361 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.476588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.477127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.477598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.479481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.682893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1287/2584] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:41:43 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:41:43.684106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.695159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585dd675-3aab-4bcf-abd2-f60dcdf25404 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.756335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.757004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.761742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.761742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.761742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.761742 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.889945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1298/2585] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:41:43 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:43.894167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.904494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbaa5f-bf98-4720-9e4e-ea85d609cf6e admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.910065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.910736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.911019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.911298 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.912014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.913639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.924839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1288/2586] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:43.929005 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.940282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e077f-e667-4a47-8c9f-3ed6ad6e2f48 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.944948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.945684 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.945973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.946256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.946985 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.948632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382c7d2-8677-4f09-8881-0c6983a9e72c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:43.958694 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1299/2587] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:43.972462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:43.973066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb54c6e-53e8-4164-ab97-01e8ed639968 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:43.977594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:43.978457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:43.978737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:43.979011 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] PATH_INFO: `/v3/projects/1d50c2ef63b54c2e955695da85169101/users/0b76a614a434430d9f356216e47b8130/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:43.994305 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d50c2ef63b54c2e955695da85169101, user_id=0b76a614a434430d9f356216e47b8130, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:43.997117 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:44.089861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1289/2588] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:41:43 2022] PUT /identity/v3/projects/1d50c2ef63b54c2e955695da85169101/users/0b76a614a434430d9f356216e47b8130/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:44.095356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec111cad-b340-42d3-bcaf-44445296f0c8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:44.095680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec111cad-b340-42d3-bcaf-44445296f0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:44.095964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec111cad-b340-42d3-bcaf-44445296f0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:44.114338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ec111cad-b340-42d3-bcaf-44445296f0c8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:44.115546 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ec111cad-b340-42d3-bcaf-44445296f0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:44.119597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:44.178340 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1300/2589] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:44.188146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:44.189868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:44.246815 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383d201-c222-4844-9d81-842f450da2d5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:44.250606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:44.251245 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:44.251529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:44.251806 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:44.260744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:44.262203 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:44.272150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1290/2590] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:50.145141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:50.145709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:50.145709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:50.191057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] MFA Rules not processed for user `0b76a614a434430d9f356216e47b8130`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:50.192522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:50.277890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1301/2591] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:50.282662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:50.296862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d30e-1a84-4512-980c-a291090b4d87 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:50.302306 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:50.303749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:50.304192 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:50.304619 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:50.306317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:50.309578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:50.316532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:50.508271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1291/2592] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:41:50 2022] POST /identity/v3/projects => generated 385 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:50.512603 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:50.549015 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f518ec-b104-4a0d-a6b9-eea593fa3bf2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:50.621310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:50.621995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:50.622280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:50.622680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:50.643289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:50.643289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:50.859675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1302/2593] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:41:50 2022] POST /identity/v3/users => generated 299 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:41:50.876292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:50.894287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab3321-ca7e-4d5f-bfcd-366489184f3d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:50.899601 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:50.900316 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:50.900604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:50.900882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:50.901680 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:50.903441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:50.921405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1292/2594] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:50.926137 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:50.936815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb5362-16c4-4d74-b4c9-975b746df55c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:50.943417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:50.944331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:50.944650 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:50.945306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] PATH_INFO: `/v3/projects/084e5bd71e2e4d62bc4943678b4361b2/users/c80d9d75dfa04f769178198dbf65f3bb/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:50.983921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=084e5bd71e2e4d62bc4943678b4361b2, user_id=c80d9d75dfa04f769178198dbf65f3bb, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:50.986838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:51.108567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1303/2595] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:41:50 2022] PUT /identity/v3/projects/084e5bd71e2e4d62bc4943678b4361b2/users/c80d9d75dfa04f769178198dbf65f3bb/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:41:51.112761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:51.123598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32484043-0a1d-4982-b593-5b043459e837 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:51.199093 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:51.199852 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:51.200136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:51.200414 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:51.201148 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:51.202893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f94b30e-2b69-4c6f-9095-f093e745dc4c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:51.214873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1293/2596] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:41:51.220276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:51.228441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:51.232239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f165d5-9165-4ff1-866f-4bbf9ec06c18 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:51.237105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:51.238138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:51.238492 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:51.238839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] PATH_INFO: `/v3/projects/084e5bd71e2e4d62bc4943678b4361b2/users/c80d9d75dfa04f769178198dbf65f3bb/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:51.240891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] RBAC: Authorizing `identity:create_grant(project_id=084e5bd71e2e4d62bc4943678b4361b2, user_id=c80d9d75dfa04f769178198dbf65f3bb, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:51.244088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e06469-0218-4ef7-8eca-454d79ccd94a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:51.261960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1304/2597] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:41:51 2022] PUT /identity/v3/projects/084e5bd71e2e4d62bc4943678b4361b2/users/c80d9d75dfa04f769178198dbf65f3bb/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:41:52.021616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:52.022159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:52.022242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:52.042227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] MFA Rules not processed for user `eaf9c9fd3a5d4791907748df8bad800c`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:52.043494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:52.113219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1294/2598] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:57.510607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f959-55e4-4ce6-a4a9-fa76508a847c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:57.511656 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f959-55e4-4ce6-a4a9-fa76508a847c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:57.512088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424f959-55e4-4ce6-a4a9-fa76508a847c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:57.548893 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-6424f959-55e4-4ce6-a4a9-fa76508a847c None None] MFA Rules not processed for user `c80d9d75dfa04f769178198dbf65f3bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:57.553988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-6424f959-55e4-4ce6-a4a9-fa76508a847c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:57.645831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1305/2599] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:41:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:57.653935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:57.655516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:57.766033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413a543-0062-4333-8558-90a30e6416f5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:57.770254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:57.770909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:57.771188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:57.771462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:57.781773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:41:57.842177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:57.844242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:57.861412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1295/2600] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:41:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:41:58.195133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8721-bbbc-41a5-a301-abcce691fb64 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:58.196020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8721-bbbc-41a5-a301-abcce691fb64 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:58.200515 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d8721-bbbc-41a5-a301-abcce691fb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:58.229971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-7a8d8721-bbbc-41a5-a301-abcce691fb64 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:41:58.233012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7a8d8721-bbbc-41a5-a301-abcce691fb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:58.302792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1306/2601] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:41:58.315985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:41:58.317560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:41:58.434788 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfba179-4d63-46b0-baf3-3726c0aa65d0 service glance] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:41:58.470966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:41:58.471787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:41:58.472071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:41:58.472343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:41:58.497684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:41:58.498791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869722e-c655-465d-9bca-2ec4e6b2b50b service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:41:58.548939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1296/2602] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:41:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:42:08.293971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:08.513958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=55 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:10.121737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:10.126090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:10.126090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:10.141485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] MFA Rules not processed for user `0b76a614a434430d9f356216e47b8130`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:42:10.142844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:10.154622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1307/2603] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:42:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:42:14.223294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:14.223749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:14.223839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:14.242092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:42:14.283270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:14.283270 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1297/2604] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:42:14.284316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:42:14.284316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8b533-3fbc-4a05-8e4b-79a18e9fa279 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:42:14.284316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:42:14.284316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:14.285033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:14.285033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:14.291140 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:42:14.292987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:42:14.302048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1308/2605] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:42:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:42:17.414133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:42:17.415760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:17.511857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dbe61-d338-4aa3-a6d8-79690b687b73 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:42:17.517542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:42:17.518454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:17.518731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:17.519007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] PATH_INFO: `/v3/users/2fe22b57fdec43aba874cc1589e84e1a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:17.520213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe22b57fdec43aba874cc1589e84e1a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:42:17.522185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:42:17.762710 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe22b57fdec43aba874cc1589e84e1a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:17.769300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe22b57fdec43aba874cc1589e84e1a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:17.784362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe22b57fdec43aba874cc1589e84e1a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:17.854957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe22b57fdec43aba874cc1589e84e1a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:17.855665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe22b57fdec43aba874cc1589e84e1a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:17.876725 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1298/2606] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:42:17 2022] DELETE /identity/v3/users/2fe22b57fdec43aba874cc1589e84e1a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:42:18.171848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:42:18.194159 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bae9f-b2aa-4503-90ac-dbb1dcd2464f service swift] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:42:18.270495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:42:18.271275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:18.271562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:18.272023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] PATH_INFO: `/v3/projects/3f91679e053a4582945dcbace6c93d24` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:18.273404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f91679e053a4582945dcbace6c93d24)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:42:18.275538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:42:18.418787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f91679e053a4582945dcbace6c93d24', 'request_id': 'req-abe9071c-fad6-40ec-827f-237dba82c4c1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:18.432616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f91679e053a4582945dcbace6c93d24', 'request_id': 'req-abe9071c-fad6-40ec-827f-237dba82c4c1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:18.442045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f91679e053a4582945dcbace6c93d24', 'request_id': 'req-abe9071c-fad6-40ec-827f-237dba82c4c1'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:18.523000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] The token cache is being invalidate because project 3f91679e053a4582945dcbace6c93d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:42:18.523211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:18.523826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-abe9071c-fad6-40ec-827f-237dba82c4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:42:18.525449 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1309/2607] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:42:18 2022] DELETE /identity/v3/projects/3f91679e053a4582945dcbace6c93d24 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:42:27.870188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:28.519607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:38.657998 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:42:38.659502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:38.718787 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2981d-cbec-47ff-bde7-1238655ad3c2 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:42:38.771185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:42:38.771840 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:38.772127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:38.772425 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:38.774791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:38.851146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:42:38.852682 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:42:38.862968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1299/2608] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:42:41.440470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:42:41.441032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:42:41.441173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:42:41.459760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] MFA Rules not processed for user `12207cbc940749eab50dc52e3319ec91`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:42:41.461113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:42:41.522360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1310/2609] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:42:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:42:48.858596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=70 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:42:51.515523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=25 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:05.483974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:05.485611 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:05.554468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c24b0d-7bb2-4bf6-a930-02f15f08db5e service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:05.559197 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:05.560385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:05.560672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:05.560988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] PATH_INFO: `/v3/users/eaf9c9fd3a5d4791907748df8bad800c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:05.562219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaf9c9fd3a5d4791907748df8bad800c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:05.564190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:05.794500 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaf9c9fd3a5d4791907748df8bad800c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:05.795224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaf9c9fd3a5d4791907748df8bad800c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:05.807064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaf9c9fd3a5d4791907748df8bad800c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:05.876396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaf9c9fd3a5d4791907748df8bad800c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:05.877041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-bbc327b8-e8bb-41de-9b50-004504b97674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaf9c9fd3a5d4791907748df8bad800c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:05.890709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1300/2610] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:43:05 2022] DELETE /identity/v3/users/eaf9c9fd3a5d4791907748df8bad800c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:43:06.170082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:06.184364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac6d9d-562f-4e86-9c8a-c6f4ff693591 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:06.243348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:06.244201 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.244486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.244765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] PATH_INFO: `/v3/projects/8c649113d597484d8d1f5f046a8cac59` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.245946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c649113d597484d8d1f5f046a8cac59)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:06.248814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:06.367428 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c649113d597484d8d1f5f046a8cac59', 'request_id': 'req-5fe1c4ab-00f8-459d-960b-d210d29a5f90'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:06.374186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c649113d597484d8d1f5f046a8cac59', 'request_id': 'req-5fe1c4ab-00f8-459d-960b-d210d29a5f90'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:06.379654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c649113d597484d8d1f5f046a8cac59', 'request_id': 'req-5fe1c4ab-00f8-459d-960b-d210d29a5f90'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:06.493569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] The token cache is being invalidate because project 8c649113d597484d8d1f5f046a8cac59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:43:06.493860 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:06.494494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-5fe1c4ab-00f8-459d-960b-d210d29a5f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:43:06.496098 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1311/2611] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:43:06 2022] DELETE /identity/v3/projects/8c649113d597484d8d1f5f046a8cac59 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:43:06.501768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.502257 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.502370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.526968 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:06.527555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:06.592363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1301/2612] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:43:06.599947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.601374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.601374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.619511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:06.620708 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:06.629461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1312/2613] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:43:06.633574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:06.643482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfab23cb-5084-41c5-94d9-f25eafd2e771 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:06.648039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:06.648688 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.648974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.649252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.650039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:43:06.650347 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:06.651950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:06.663542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1302/2614] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:43:06.667604 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:06.677500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb330bf-24d7-4281-8573-f1c7936016c8 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:06.682433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:06.683111 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.683394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.683668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.684924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:06.686882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:06.816844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1313/2615] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:43:06 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:43:06.820297 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:06.830938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf201a-a722-4e57-89c0-ace93ab94990 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:06.834618 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:06.890598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:06.891268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:06.891571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:06.891847 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:06.892542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:06.894536 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:07.042915 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1303/2616] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:43:06 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:43:07.047624 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:07.057792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee7ee7-4250-4b64-b204-fb31164deee2 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:07.062658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:07.063319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:07.063683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:07.063989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:07.064700 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:07.066337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:07.077082 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1314/2617] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:43:07.081049 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:07.091960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826f184-a08a-4999-8a79-3d3e5d6db10f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:07.096890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:07.097624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:07.097944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:07.098223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:07.098941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:07.100609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c24b4-76ec-447d-9cd5-3a83842869fd admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:07.111223 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1304/2618] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:43:07.115246 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:07.125634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409a2ef-5cb1-436d-b6ab-8b0025768458 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:07.130156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:07.131041 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:07.131332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:07.131663 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] PATH_INFO: `/v3/projects/e64d3975127c49b387c4f167cd3f269a/users/e1de9e641be64405ba746e9408108e53/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:07.146465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e64d3975127c49b387c4f167cd3f269a, user_id=e1de9e641be64405ba746e9408108e53, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:07.149148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:07.295058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1315/2619] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:43:07 2022] PUT /identity/v3/projects/e64d3975127c49b387c4f167cd3f269a/users/e1de9e641be64405ba746e9408108e53/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:43:07.300284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:07.300569 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:07.300857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:07.318871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:07.320088 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:07.380201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1305/2620] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:43:07.391718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:07.393473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:07.425499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:07.452676 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92159068-6931-406c-a10d-8d440cf84b87 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:07.456415 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:07.457058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:07.457373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:07.457658 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:07.468488 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:07.469983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:07.479446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1316/2621] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:08.860734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:08.862222 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:08.874969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e8f0a-4a77-41c0-a84d-4c2a4233869d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:08.878662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:08.879381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:08.879761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:08.880104 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:08.881985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:08.968624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:08.970083 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bcdd31-8906-4ee0-bac3-be76d71229a8 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:08.983363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1306/2622] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:10.283648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:10.292297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69052c-057f-47e8-9460-e36658ca47cc service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:10.296601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:10.297696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:10.298162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:10.298475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:10.300737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:10.319671 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:10.321241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:10.334698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1317/2623] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:14.089930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe9c70-f194-4360-9e6f-fa33932d567e None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:14.090941 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe9c70-f194-4360-9e6f-fa33932d567e None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:14.091041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe9c70-f194-4360-9e6f-fa33932d567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:14.111302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:14.119810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c2fe9c70-f194-4360-9e6f-fa33932d567e None None] MFA Rules not processed for user `e1de9e641be64405ba746e9408108e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:14.120924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c2fe9c70-f194-4360-9e6f-fa33932d567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:14.186445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1307/2624] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:43:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:43:14.201172 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:14.202948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:14.218619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07d4912-cf87-4b61-a92f-6cf3174d867b service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:14.224165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:14.225039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:14.225521 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:14.225799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:14.235055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:14.237765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:14.247298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1318/2625] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:17.007032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:17.008958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:17.008958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:17.028103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] MFA Rules not processed for user `e1de9e641be64405ba746e9408108e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:17.029821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:17.037835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1308/2626] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:43:17.370598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:17.380996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6972fc9a-b6d6-47a9-8c67-16810e229d32 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:17.385332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:17.385981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:17.386269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:17.386551 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:17.388851 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:17.399653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:17.401199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:17.410289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1319/2627] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:18.056657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:18.137745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:18.137745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7a62-64aa-42f6-abf2-fba835e6e3e8 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:18.140273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:18.140995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:18.141308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:18.141600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:18.147059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:18.159945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:18.161737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:18.172844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1309/2628] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:22.444265 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:22.453305 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6fe-bb73-492f-9341-2aa64a5cbf1e service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:22.457252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:22.458904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:22.458904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:22.458904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:22.460357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:22.474107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:22.478012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92556105-25c6-4d7b-81e8-fa8a42ac133b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:22.487820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1320/2629] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:28.167800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=62 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:32.483762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=38 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:32.958156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:32.959588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:32.975308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a670529-3cb7-4ccd-bf53-200825d8ec2e service placement] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:32.980639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:32.981288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:32.981585 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:32.981860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:32.983600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:33.040699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:33.042314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47e1462-e7aa-44f2-90b4-d8df977f06b5 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:33.051877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1310/2630] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:42.428473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0e44-f61d-4060-897e-a34a8c095070 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.429108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0e44-f61d-4060-897e-a34a8c095070 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.429287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c0e44-f61d-4060-897e-a34a8c095070 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.430983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1321/2631] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:43:42.436937 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34922f4-77f3-4740-8da5-e95995e36204 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.437447 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34922f4-77f3-4740-8da5-e95995e36204 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.438216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34922f4-77f3-4740-8da5-e95995e36204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.457017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a34922f4-77f3-4740-8da5-e95995e36204 None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:42.459007 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a34922f4-77f3-4740-8da5-e95995e36204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:42.466538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1311/2632] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:43:42.479997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0e44-f61d-4060-897e-a34a8c095070 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:42.493248 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487c0e44-f61d-4060-897e-a34a8c095070 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:42.496819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:42.497498 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.501442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.501442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.505904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:42.507469 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13af638-32b4-4081-a6f5-12d4e7e8c00b service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:42.516858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1322/2633] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:42.618076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1d79-c34d-4e34-9d91-9b6a60c0c879 None None] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.618394 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1d79-c34d-4e34-9d91-9b6a60c0c879 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.618700 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad1d79-c34d-4e34-9d91-9b6a60c0c879 None None] PATH_INFO: `/` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.620144 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1312/2634] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:43:42.625737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.626033 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.626310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.674049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:43:42.674049 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:42.678443 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1323/2635] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:43:42.695803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad1d79-c34d-4e34-9d91-9b6a60c0c879 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:42.701592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad1d79-c34d-4e34-9d91-9b6a60c0c879 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:42.705133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:42.705916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:42.706207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:42.706485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:42.718095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:42.719568 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:42.731256 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1313/2636] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:43.286891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:43.299036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201e169-bc00-4b6a-9ab1-6c35516f4a91 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:43.306027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:43.306883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:43.307179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:43.307462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:43.309349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:43.322789 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:43.324486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:43.335455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1324/2637] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:52.726133 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=37 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:43:52.968395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:43:52.980765 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721041a6-1909-4c55-a678-412d08b963df service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:43:52.987199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:43:52.988004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:43:52.988299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:43:52.988639 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:43:52.990453 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:43:53.009590 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:43:53.011878 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:43:53.025880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1314/2638] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:43:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:43:53.330770 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=21 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:00.483447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:00.493152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5092aeba-e211-4cf1-9e7a-7e1038da2c11 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:00.496783 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:00.497462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:00.497787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:00.498077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:00.499819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:00.511993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:00.515413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:00.524061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1325/2639] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:03.021507 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=6 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:04.271370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:04.273367 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:04.290101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e511640-3dc0-4f09-84f9-d492f22c0628 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:04.295054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:04.296092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:04.296384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:04.296664 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] PATH_INFO: `/v3/users/12207cbc940749eab50dc52e3319ec91` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:04.297945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] RBAC: Authorizing `identity:delete_user(user_id=12207cbc940749eab50dc52e3319ec91)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:04.299862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:04.508812 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12207cbc940749eab50dc52e3319ec91'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:04.509545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12207cbc940749eab50dc52e3319ec91'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:04.524591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12207cbc940749eab50dc52e3319ec91'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:04.590698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12207cbc940749eab50dc52e3319ec91'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:04.591323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-acf05fe2-f5bd-4e5f-b1c4-05aefc4518de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12207cbc940749eab50dc52e3319ec91'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:04.606242 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1315/2640] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:04 2022] DELETE /identity/v3/users/12207cbc940749eab50dc52e3319ec91 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:04.890398 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:04.895977 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae30a89-cbc4-461a-963a-d3cb7fddd4e8 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:04.956748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:04.957682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:04.957973 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:04.958253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] PATH_INFO: `/v3/projects/3ca63dae986749728daf5c42db0d14e3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:04.959572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca63dae986749728daf5c42db0d14e3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:04.962043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.064690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca63dae986749728daf5c42db0d14e3', 'request_id': 'req-0b7e70be-9db0-426b-affe-deb40549e075'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:05.070983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca63dae986749728daf5c42db0d14e3', 'request_id': 'req-0b7e70be-9db0-426b-affe-deb40549e075'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:05.076622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca63dae986749728daf5c42db0d14e3', 'request_id': 'req-0b7e70be-9db0-426b-affe-deb40549e075'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:05.149010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] The token cache is being invalidate because project 3ca63dae986749728daf5c42db0d14e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:05.150084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:05.150815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-0b7e70be-9db0-426b-affe-deb40549e075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:05.152350 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1326/2641] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:04 2022] DELETE /identity/v3/projects/3ca63dae986749728daf5c42db0d14e3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:05.157360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.157650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.157924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.175914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:05.177101 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:05.234793 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1316/2642] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:05.242674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.243129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.243730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.262587 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:05.263779 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:05.271602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1327/2643] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:05.276354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.285906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbfe51-c0cc-4ef4-9f3d-7c56e4ddad80 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.290593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.291236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.291515 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.291791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.292506 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:05.292809 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.294420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.305912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1317/2644] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:44:05.310253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.319429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b52552-620d-4890-b730-a5b06b79e5f2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.324686 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.325367 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.325657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.325934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.326622 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.328506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.403611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1328/2645] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:05 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:44:05.407865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.417894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f350b-d044-4461-8ea6-10dc3454d304 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.475243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.475912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.476199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.476480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.477178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.479455 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.486033 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:05.591178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1318/2646] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:05 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:05.595611 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.606021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de5a8-ca26-4986-a6d8-cdcb11bb54ab admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.610865 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.611630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.611915 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.612190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.613002 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.614630 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.625898 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1329/2647] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:05.630195 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.642645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39726b9b-835d-44c2-bacd-2dae4d8a61c4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.647448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.648107 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.648396 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.648676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.649475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.651073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f27e3-23bb-44ee-b894-8e2f57da533f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.661762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1319/2648] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:05.666145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.676123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7cf02-5748-4f68-b411-4aa539579c60 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.681669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.682561 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.682871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.683152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] PATH_INFO: `/v3/projects/b7909a6572f34ecfba9b58e79f4ee941/users/323c9df9e91a4599a309436633b7680f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.698396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7909a6572f34ecfba9b58e79f4ee941, user_id=323c9df9e91a4599a309436633b7680f, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.701037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.778894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1330/2649] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:05 2022] PUT /identity/v3/projects/b7909a6572f34ecfba9b58e79f4ee941/users/323c9df9e91a4599a309436633b7680f/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:05.789174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.789528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.789969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.815969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] MFA Rules not processed for user `323c9df9e91a4599a309436633b7680f`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:05.817168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:05.880861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1320/2650] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:05.892702 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:05.894438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:05.909571 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:05.970729 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4b83f-e6bd-4e7a-a915-37f5335b7e2c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:05.976191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:05.976834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:05.977716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:05.978123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:05.985910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:05.987486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:05.997079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1331/2651] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:09.191221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:09.223448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960ecd-b954-4968-97ba-e45cae2c72f5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:09.236689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:09.236689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:09.236689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:09.243138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:09.246103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:09.251130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:09.264393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:09.266728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf78ee8-6f2d-4f9e-99b2-7ccdaf0da6c3 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:09.295295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1321/2652] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:09.368300 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c5ae6-3a55-4925-ba62-2dbe7294bace service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:09.379215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:09.382366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:09.382797 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:09.383182 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] PATH_INFO: `/v3/users/323c9df9e91a4599a309436633b7680f` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:09.385717 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] RBAC: Authorizing `identity:delete_user(user_id=323c9df9e91a4599a309436633b7680f)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:09.388019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:09.581169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323c9df9e91a4599a309436633b7680f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:09.598069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323c9df9e91a4599a309436633b7680f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:09.666088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323c9df9e91a4599a309436633b7680f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:09.666982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323c9df9e91a4599a309436633b7680f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:09.670778 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323c9df9e91a4599a309436633b7680f'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:09.691901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1332/2653] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:09 2022] DELETE /identity/v3/users/323c9df9e91a4599a309436633b7680f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:09.694206 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:09.699867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:09.699867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:09.729095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:09.730993 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:09.803609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1322/2654] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:09.812485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:09.812485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:09.834737 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:09.877573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4d850-73cd-4534-838f-64c835da221b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:09.881829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:09.882491 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:09.882775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:09.883051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:09.894990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:09.896470 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa40c719-59c4-4887-8eca-97860444ad8c service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:09.910274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1333/2655] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:10.643471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:10.645013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:10.661183 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d3f8f-6771-496a-8a6b-9879a3052ac4 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:10.665622 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:10.666656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:10.667081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:10.667395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] PATH_INFO: `/v3/projects/b7909a6572f34ecfba9b58e79f4ee941` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:10.669332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7909a6572f34ecfba9b58e79f4ee941)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:10.671571 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:10.831681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7909a6572f34ecfba9b58e79f4ee941', 'request_id': 'req-699923b3-1523-48ce-a874-7e685718e8e8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:10.833430 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:INSERT=3,keystone:SELECT=93,keystone:DELETE=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:10.839771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7909a6572f34ecfba9b58e79f4ee941', 'request_id': 'req-699923b3-1523-48ce-a874-7e685718e8e8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:10.846777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7909a6572f34ecfba9b58e79f4ee941', 'request_id': 'req-699923b3-1523-48ce-a874-7e685718e8e8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:10.961525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] The token cache is being invalidate because project b7909a6572f34ecfba9b58e79f4ee941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:10.961818 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:10.962484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-699923b3-1523-48ce-a874-7e685718e8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:10.978819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1323/2656] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:10 2022] DELETE /identity/v3/projects/b7909a6572f34ecfba9b58e79f4ee941 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:10.978996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:10.978996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:10.978996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:10.988143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:10.989420 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:11.053885 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1334/2657] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:11.063258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.063565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.063854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.082794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:11.084006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:11.092407 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1324/2658] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:11.096704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.107153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a020a9-5ab3-4cb0-81a9-e7b8c1271cfe None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.112122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.112790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.113314 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.113433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.114109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:11.114417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.116042 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.133215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1335/2659] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:44:11.134882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.144869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02bc078-891d-40bb-9161-a278f1d686db None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.149934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.150746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.151112 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.151458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.152216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.154252 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.260384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1325/2660] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:11.261584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.272040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aac487-d71c-49d4-9a6c-89cf142d639d admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.331881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.332889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.333374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.333657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.334396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.336349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.399872 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1336/2661] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/users => generated 300 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:44:11.401330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.412912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af67f6-93b3-4806-a2b0-1629d2d096dc admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.419113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.421160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.421160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.421160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.421160 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.422823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.435458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1326/2662] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:11.439460 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.450081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeaec8-2630-44d7-8cd6-658968f9c477 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.454882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.455552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.455834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.458479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.458479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.458479 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166e7a8-e764-4f0e-b2e6-91ea87fac4ef admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.470214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1337/2663] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:11.474353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.485613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6164358-1b26-4b7f-b86c-2d3c123d3a1d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.490303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.491226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.491511 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.491786 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] PATH_INFO: `/v3/projects/e61c5ad10ccb4636afcd521c193b891b/users/a540b7893a1f404f9cac1d023c6ed5d7/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.509703 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61c5ad10ccb4636afcd521c193b891b, user_id=a540b7893a1f404f9cac1d023c6ed5d7, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.514035 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.591393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1327/2664] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:11 2022] PUT /identity/v3/projects/e61c5ad10ccb4636afcd521c193b891b/users/a540b7893a1f404f9cac1d023c6ed5d7/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:11.596522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.596815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.597107 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.632109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] MFA Rules not processed for user `a540b7893a1f404f9cac1d023c6ed5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:11.633607 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:11.653431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:11.716745 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1338/2665] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:11.721281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.788965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da54ea-bc4b-4179-9165-8a0fe3b18221 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:11.794771 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:11.795475 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:11.795782 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:11.796060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:11.796804 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:11.798942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:11.947405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1328/2666] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/projects => generated 401 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:11.951379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:11.963018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae4a94-c901-4586-8484-3098cafe3296 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.019924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.021066 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.021718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.022247 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.023577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.027966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.132408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1339/2667] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:11 2022] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:12.133651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.144859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8936ba-4a0c-4368-a2d8-69b44d87aaf7 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.149572 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.151013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.151302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.151579 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.152295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.153944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.164528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1329/2668] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:12.169108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.180260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5630a9-b8b6-4634-aaad-fa0ddcfe6928 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.185815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.186617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.187014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.187411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] PATH_INFO: `/v3/projects/1a2d67bc074049278e16ff25a581f844/users/41046e01aee249e7bbf188707725034c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.206223 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2d67bc074049278e16ff25a581f844, user_id=41046e01aee249e7bbf188707725034c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.209228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.300483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1340/2669] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:12 2022] PUT /identity/v3/projects/1a2d67bc074049278e16ff25a581f844/users/41046e01aee249e7bbf188707725034c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:12.304654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.316421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff946a-99b8-4273-a06f-90bc2bfaacf2 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.367722 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:12.382444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.385177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.385177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.385177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.385581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.387236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33039d-a1fd-4f77-9e41-4339b4554f93 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.399313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1330/2670] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:12.403874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.416617 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db30234-9eef-4877-a729-21fbfac65523 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.421497 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.422392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.422683 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.423031 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] PATH_INFO: `/v3/projects/1a2d67bc074049278e16ff25a581f844/users/41046e01aee249e7bbf188707725034c/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.425632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a2d67bc074049278e16ff25a581f844, user_id=41046e01aee249e7bbf188707725034c, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.427773 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.440164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1341/2671] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:12 2022] PUT /identity/v3/projects/1a2d67bc074049278e16ff25a581f844/users/41046e01aee249e7bbf188707725034c/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:12.451186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.451483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.451767 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.480096 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] MFA Rules not processed for user `41046e01aee249e7bbf188707725034c`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:12.481366 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:12.556441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1331/2672] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:12.567188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.568874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:12.626310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024da0db-4bdb-4b23-aeb2-31d0718cdb41 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.629913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.630547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.630827 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.631100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.640662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.642113 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59d36fd-98ad-4d2f-b360-479210fe1a83 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:12.652595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1342/2673] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:12.784672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:12.848208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f8778-ef56-4246-a2db-632d76b8a97a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:12.852685 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:12.853593 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:12.853885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:12.854165 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] PATH_INFO: `/v3/users/a540b7893a1f404f9cac1d023c6ed5d7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:12.855352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a540b7893a1f404f9cac1d023c6ed5d7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:12.857322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:13.183262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a540b7893a1f404f9cac1d023c6ed5d7'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:13.183934 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a540b7893a1f404f9cac1d023c6ed5d7'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:13.198484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a540b7893a1f404f9cac1d023c6ed5d7'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:13.276100 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a540b7893a1f404f9cac1d023c6ed5d7'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:13.276802 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a540b7893a1f404f9cac1d023c6ed5d7'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:13.278484 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:13.292207 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1332/2674] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:12 2022] DELETE /identity/v3/users/a540b7893a1f404f9cac1d023c6ed5d7 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:13.296615 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:13.297179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:13.297292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:13.315910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:13.317323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:13.323754 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:13.388387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1343/2675] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:13.395199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:13.396686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:13.473899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e2de7-6a14-439d-a949-d7de996562da admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:13.477556 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:13.488393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:13.488393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:13.488393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:13.488882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:13.490280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:13.501538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1333/2676] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:13.964422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:13.965935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:13.981879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14830de4-ef04-4433-b51d-beff70ac0c36 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:13.989039 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:13.990072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:13.990360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:13.990642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] PATH_INFO: `/v3/projects/e61c5ad10ccb4636afcd521c193b891b` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:13.993734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61c5ad10ccb4636afcd521c193b891b)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:13.995940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:14.128395 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61c5ad10ccb4636afcd521c193b891b', 'request_id': 'req-eb920854-39f9-4e00-b4cf-2af63f9e09eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.135374 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61c5ad10ccb4636afcd521c193b891b', 'request_id': 'req-eb920854-39f9-4e00-b4cf-2af63f9e09eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.141197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61c5ad10ccb4636afcd521c193b891b', 'request_id': 'req-eb920854-39f9-4e00-b4cf-2af63f9e09eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.220514 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] The token cache is being invalidate because project e61c5ad10ccb4636afcd521c193b891b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:14.220764 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.221375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.223000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1344/2677] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:13 2022] DELETE /identity/v3/projects/e61c5ad10ccb4636afcd521c193b891b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:14.227017 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:14.237163 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b10ae-f804-4152-906c-cde5bd3ee90d service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:14.295656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:14.296576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:14.296876 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:14.297159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] PATH_INFO: `/v3/users/41046e01aee249e7bbf188707725034c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:14.298377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] RBAC: Authorizing `identity:delete_user(user_id=41046e01aee249e7bbf188707725034c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:14.300383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:14.495972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41046e01aee249e7bbf188707725034c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.496665 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41046e01aee249e7bbf188707725034c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.509973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41046e01aee249e7bbf188707725034c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.579135 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41046e01aee249e7bbf188707725034c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.579817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-def8fe60-2176-4b4b-beca-577e9800c68a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41046e01aee249e7bbf188707725034c'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:14.593437 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1334/2678] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:14 2022] DELETE /identity/v3/users/41046e01aee249e7bbf188707725034c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:15.030886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.032397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:15.047109 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb920854-39f9-4e00-b4cf-2af63f9e09eb admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.111170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.112036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.112342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.112677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] PATH_INFO: `/v3/projects/1a2d67bc074049278e16ff25a581f844` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.114474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a2d67bc074049278e16ff25a581f844)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.118094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.254344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:15.266902 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a2d67bc074049278e16ff25a581f844', 'request_id': 'req-dfce3565-99b6-439b-b5f6-0c8a8936bcec'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:15.276152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a2d67bc074049278e16ff25a581f844', 'request_id': 'req-dfce3565-99b6-439b-b5f6-0c8a8936bcec'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:15.279399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a2d67bc074049278e16ff25a581f844', 'request_id': 'req-dfce3565-99b6-439b-b5f6-0c8a8936bcec'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:15.372829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] The token cache is being invalidate because project 1a2d67bc074049278e16ff25a581f844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:15.373239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:15.373894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfce3565-99b6-439b-b5f6-0c8a8936bcec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:15.375695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1345/2679] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:15 2022] DELETE /identity/v3/projects/1a2d67bc074049278e16ff25a581f844 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:15.380764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.381291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.381412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.401021 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:15.402274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:15.407595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:15.466560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1335/2680] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:15.475966 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.476335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.476732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.502567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:15.502567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:15.506939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1346/2681] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:15.511803 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.521935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470a0f7-4134-499f-9feb-16ca43e79536 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.526836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.527504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.529512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.529833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.530599 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:15.530953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.532641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.545695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1336/2682] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:44:15.549997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.559856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931fe58-0c48-4b18-ac38-dec5531b9c91 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.564634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.565309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.565595 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.565871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.566605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.568534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.701326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1347/2683] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:15 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:15.705393 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.715719 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496add1-77bb-40ba-9e8d-0a45cfbec3d9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.774854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.775516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.775795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.776065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.776796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.778737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.876420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1337/2684] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:15 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:15.880633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.891256 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd7686-2635-48cb-a2a0-11ece158e9dc admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.895931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.896585 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.896871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.897149 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.897963 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.899601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.909715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1348/2685] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:15.914848 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.925498 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46338a89-0c75-4e8d-874e-76e7d93b11c6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.930084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.931485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.931772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.932060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.932790 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.934454 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fce442-5e32-4b4e-850f-a50a110a40c3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:15.944267 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1338/2686] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:15.950755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:15.960781 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0423da-64e0-4158-a0d3-41b35f10cd43 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:15.965434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:15.966365 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:15.966646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:15.966920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] PATH_INFO: `/v3/projects/f7ec588e3fa346e6af495af7079594f9/users/f4cf2d66f0ac4f48927575536593eb5a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:15.982501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ec588e3fa346e6af495af7079594f9, user_id=f4cf2d66f0ac4f48927575536593eb5a, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:15.985289 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.094680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1349/2687] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:15 2022] PUT /identity/v3/projects/f7ec588e3fa346e6af495af7079594f9/users/f4cf2d66f0ac4f48927575536593eb5a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:16.105640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.105965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.106263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.132907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] MFA Rules not processed for user `f4cf2d66f0ac4f48927575536593eb5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:16.134810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:16.198496 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1339/2688] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:16.203001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.264820 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d583ba-9e66-4099-900e-4ff560375ae4 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.269556 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.270216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.270509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.270795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.271482 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.273409 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.397356 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1350/2689] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:16 2022] POST /identity/v3/projects => generated 377 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:16.402533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.413304 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8e475-2c53-4676-bbc8-6d88cc374eb0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.417028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:16.472081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.473478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.473478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.473478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.474028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.475949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.567422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1340/2690] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:16 2022] POST /identity/v3/users => generated 295 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:16.576164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.586756 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da364326-f7c5-486b-a051-86f03a47e684 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.592446 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.593102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.593422 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.593703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.594463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.596055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.606863 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1351/2691] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:16.611010 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.620883 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee7662-5078-4e62-a61d-a3ecd578c0e6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.625380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197514-f233-4985-8785-6b25168df229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.626248 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197514-f233-4985-8785-6b25168df229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.626529 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197514-f233-4985-8785-6b25168df229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.626800 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be197514-f233-4985-8785-6b25168df229 admin admin] PATH_INFO: `/v3/projects/f5fab2fa74cd4354b43674354f6e8417/users/89a09086cd014782baae8915e3d8f96f/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.641699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197514-f233-4985-8785-6b25168df229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fab2fa74cd4354b43674354f6e8417, user_id=89a09086cd014782baae8915e3d8f96f, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.644281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be197514-f233-4985-8785-6b25168df229 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.734402 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1341/2692] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:16 2022] PUT /identity/v3/projects/f5fab2fa74cd4354b43674354f6e8417/users/89a09086cd014782baae8915e3d8f96f/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:16.738411 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.749146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7b83-5c3c-4c46-9a8f-0cc5a9a565e5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.772601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:16.805139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.805962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.806453 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.806897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.807989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.809943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd702380-e56f-4077-85b6-37d5366e107f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.820099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1352/2693] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:16.824274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197514-f233-4985-8785-6b25168df229 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.834669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be197514-f233-4985-8785-6b25168df229 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:16.840410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:16.841296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.841581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.841854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] PATH_INFO: `/v3/projects/f5fab2fa74cd4354b43674354f6e8417/users/89a09086cd014782baae8915e3d8f96f/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.844054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5fab2fa74cd4354b43674354f6e8417, user_id=89a09086cd014782baae8915e3d8f96f, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:16.846706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:16.857463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1342/2694] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:16 2022] PUT /identity/v3/projects/f5fab2fa74cd4354b43674354f6e8417/users/89a09086cd014782baae8915e3d8f96f/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:16.871273 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e663-cde2-4c72-83fe-3faffae76683 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:16.871566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e663-cde2-4c72-83fe-3faffae76683 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:16.871897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881e663-cde2-4c72-83fe-3faffae76683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:16.898484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-8881e663-cde2-4c72-83fe-3faffae76683 None None] MFA Rules not processed for user `89a09086cd014782baae8915e3d8f96f`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:16.900282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8881e663-cde2-4c72-83fe-3faffae76683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:16.966811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1353/2695] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:16.978420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:16.980108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:17.036921 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c068f4-162f-40d9-9a05-74829c9ca4be admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:17.041508 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:17.042153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:17.042472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:17.042753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:17.100140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:17.101609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:17.110650 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1343/2696] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:19.966133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:19.966594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:19.967495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:19.986904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:19.988141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:20.043326 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1354/2697] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:44:20.083789 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:20.085227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:20.100142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:20.155873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2885a0-ec8f-4bdc-9200-72f65f77c72c service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:20.161534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:20.162175 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:20.162457 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:20.162728 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:20.170892 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:20.172486 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:20.180477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1344/2698] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:44:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:44:20.384494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:20.394978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d628a-420b-4301-9134-5562733f3c1b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:20.398589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:20.399231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:20.399516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:20.399825 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:20.408889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:20.410360 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:20.419712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1355/2699] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:25.286518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:25.287977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:25.358635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869e1bca-4788-48ff-9865-d813e99ed08d service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:25.363533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:25.364178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:25.364545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:25.364854 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:25.366851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:25.378924 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:25.380434 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:25.391549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1345/2700] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:29.030991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:29.042253 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc119b0-d32a-4b69-ae25-c1a8f83f8082 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:29.047990 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:29.048632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:29.048917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:29.049195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:29.051014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:29.070757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:29.072399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:29.084257 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1356/2701] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:29.181243 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:29.183490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:29.254380 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cf650-4980-4b9a-972f-374ab8bcff27 service placement] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:29.259146 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:29.260056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:29.260340 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:29.260620 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] PATH_INFO: `/v3/users/0b76a614a434430d9f356216e47b8130` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:29.261885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b76a614a434430d9f356216e47b8130)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:29.263989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:29.400832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:29.410945 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b76a614a434430d9f356216e47b8130'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:29.412797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b76a614a434430d9f356216e47b8130'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:29.427919 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b76a614a434430d9f356216e47b8130'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:29.515699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b76a614a434430d9f356216e47b8130'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:29.516349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b76a614a434430d9f356216e47b8130'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:29.530099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1346/2702] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:29 2022] DELETE /identity/v3/users/0b76a614a434430d9f356216e47b8130 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:29.769405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:29.786368 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17351e-7692-44c5-a4a4-306f5a1e6181 service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:29.813014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:29.845648 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:29.846504 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:29.846786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:29.847058 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] PATH_INFO: `/v3/projects/1d50c2ef63b54c2e955695da85169101` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:29.848222 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d50c2ef63b54c2e955695da85169101)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:29.850146 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:30.031199 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d50c2ef63b54c2e955695da85169101', 'request_id': 'req-7eab59af-4bad-4e62-be66-053aee0dee0c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.037584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d50c2ef63b54c2e955695da85169101', 'request_id': 'req-7eab59af-4bad-4e62-be66-053aee0dee0c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.042889 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d50c2ef63b54c2e955695da85169101', 'request_id': 'req-7eab59af-4bad-4e62-be66-053aee0dee0c'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.173583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] The token cache is being invalidate because project 1d50c2ef63b54c2e955695da85169101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:30.173877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.174576 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.176130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1357/2703] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:29 2022] DELETE /identity/v3/projects/1d50c2ef63b54c2e955695da85169101 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:30.180078 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:30.181497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:30.195020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd8fb2e-8e17-4d74-8f40-981d387e72b1 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:30.250923 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:30.251835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:30.252113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:30.252385 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] PATH_INFO: `/v3/users/c80d9d75dfa04f769178198dbf65f3bb` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:30.253595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80d9d75dfa04f769178198dbf65f3bb)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:30.255499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:30.462692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80d9d75dfa04f769178198dbf65f3bb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.463740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80d9d75dfa04f769178198dbf65f3bb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.476489 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80d9d75dfa04f769178198dbf65f3bb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.573891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80d9d75dfa04f769178198dbf65f3bb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.574707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80d9d75dfa04f769178198dbf65f3bb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:30.595199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1347/2704] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:30 2022] DELETE /identity/v3/users/c80d9d75dfa04f769178198dbf65f3bb => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:30.906379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:30.911209 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:30.922868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab59af-4bad-4e62-be66-053aee0dee0c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:30.980445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:30.981337 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:30.981626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:30.981903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] PATH_INFO: `/v3/projects/084e5bd71e2e4d62bc4943678b4361b2` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:30.983935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=084e5bd71e2e4d62bc4943678b4361b2)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:30.985890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:31.093392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '084e5bd71e2e4d62bc4943678b4361b2', 'request_id': 'req-1c0aeeba-31d7-47b1-a658-26481ba14b95'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:31.099721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '084e5bd71e2e4d62bc4943678b4361b2', 'request_id': 'req-1c0aeeba-31d7-47b1-a658-26481ba14b95'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:31.103646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:31.105791 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '084e5bd71e2e4d62bc4943678b4361b2', 'request_id': 'req-1c0aeeba-31d7-47b1-a658-26481ba14b95'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:31.189716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] The token cache is being invalidate because project 084e5bd71e2e4d62bc4943678b4361b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:31.189947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:31.190573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1c0aeeba-31d7-47b1-a658-26481ba14b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:31.192119 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1358/2705] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:30 2022] DELETE /identity/v3/projects/084e5bd71e2e4d62bc4943678b4361b2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:35.818155 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:35.819604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:35.833131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e786765-de12-46bf-a69b-618fc3331c8c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:35.864110 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:35.892953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:35.893990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:35.894284 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:35.894577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] PATH_INFO: `/v3/users/f4cf2d66f0ac4f48927575536593eb5a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:35.896228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cf2d66f0ac4f48927575536593eb5a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:35.898390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:36.079668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cf2d66f0ac4f48927575536593eb5a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:36.080346 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cf2d66f0ac4f48927575536593eb5a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:36.093851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cf2d66f0ac4f48927575536593eb5a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:36.178276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cf2d66f0ac4f48927575536593eb5a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:36.178890 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cf2d66f0ac4f48927575536593eb5a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:36.192026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1348/2706] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:35 2022] DELETE /identity/v3/users/f4cf2d66f0ac4f48927575536593eb5a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:36.196526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1a4e-c0ed-452f-aa38-8391ae307b60 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:36.197014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1a4e-c0ed-452f-aa38-8391ae307b60 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:36.197164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19b1a4e-c0ed-452f-aa38-8391ae307b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:36.215020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-c19b1a4e-c0ed-452f-aa38-8391ae307b60 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:36.217689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-c19b1a4e-c0ed-452f-aa38-8391ae307b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:36.276128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1359/2707] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:36.287235 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:36.288773 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:36.360032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e31442-112a-4744-8f1b-020dab99b9f9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:36.363663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:36.364296 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:36.364578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:36.364856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:36.374064 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:36.375596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:36.385212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1349/2708] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:44:36.475914 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:36.476211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:36.476474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:36.495516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:36.496724 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:36.564554 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1360/2709] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:44:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:36.576422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:36.578512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:36.640004 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:36.658031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f2145-5310-400e-8b99-9811793fbea7 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:36.663018 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:36.663954 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:36.664772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:36.665062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:36.674232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:36.675813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:36.684273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1350/2710] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:44:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:44:36.871845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:36.874072 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:36.892170 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be401115-2449-4dae-98ea-b503ae52dbf0 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:36.897139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:36.898195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:36.898555 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:36.898906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] PATH_INFO: `/v3/projects/f7ec588e3fa346e6af495af7079594f9` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:36.900275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ec588e3fa346e6af495af7079594f9)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:36.902593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:37.005956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ec588e3fa346e6af495af7079594f9', 'request_id': 'req-1fe4c903-398a-449f-93d1-6b4d6394076e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.012739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ec588e3fa346e6af495af7079594f9', 'request_id': 'req-1fe4c903-398a-449f-93d1-6b4d6394076e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.021168 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ec588e3fa346e6af495af7079594f9', 'request_id': 'req-1fe4c903-398a-449f-93d1-6b4d6394076e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.078557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] The token cache is being invalidate because project f7ec588e3fa346e6af495af7079594f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:37.078879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.079610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.081505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1361/2711] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:36 2022] DELETE /identity/v3/projects/f7ec588e3fa346e6af495af7079594f9 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:37.085227 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:37.098002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b33d3-47af-41b1-8ba3-4d360757c4b3 service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:37.171044 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:37.172072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:37.172456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:37.172830 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] PATH_INFO: `/v3/users/89a09086cd014782baae8915e3d8f96f` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:37.174176 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a09086cd014782baae8915e3d8f96f)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:37.176156 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:37.401523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a09086cd014782baae8915e3d8f96f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.402390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a09086cd014782baae8915e3d8f96f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.418772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a09086cd014782baae8915e3d8f96f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.499300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a09086cd014782baae8915e3d8f96f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.500032 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-aa45d29e-3320-4241-976c-0184b9fd9551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a09086cd014782baae8915e3d8f96f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:37.525518 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1351/2712] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:37 2022] DELETE /identity/v3/users/89a09086cd014782baae8915e3d8f96f => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:38.135775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:38.137483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:38.191961 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4c903-398a-449f-93d1-6b4d6394076e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:38.207459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:38.275993 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:38.276934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.277219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.277541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] PATH_INFO: `/v3/projects/f5fab2fa74cd4354b43674354f6e8417` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.278762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5fab2fa74cd4354b43674354f6e8417)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:38.281238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:38.416506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5fab2fa74cd4354b43674354f6e8417', 'request_id': 'req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:38.424325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5fab2fa74cd4354b43674354f6e8417', 'request_id': 'req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:38.434707 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5fab2fa74cd4354b43674354f6e8417', 'request_id': 'req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:38.559767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] The token cache is being invalidate because project f5fab2fa74cd4354b43674354f6e8417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:38.566122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:38.566122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-6e63efc1-93e9-4c7d-984c-23f6901ed6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:38.566122 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1362/2713] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:38 2022] DELETE /identity/v3/projects/f5fab2fa74cd4354b43674354f6e8417 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:38.568061 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.568548 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.568654 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.589636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:38.594616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:38.661575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1352/2714] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:38.669519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.669882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.670935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.694828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:38.696064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:38.710421 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1363/2715] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:38.719119 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:38.726517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:38.732177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd451579-8ee1-4161-9beb-ae5d4b832c35 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:38.739605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:38.739605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.742895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.742895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.742895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:38.742895 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:38.744534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:38.758002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1353/2716] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:44:38.762822 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:38.775241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45424dd-6ed4-437d-a8b3-739a4f0c571f None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:38.783534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:38.784142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.784401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.784674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.785408 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:38.787335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:38.868710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1364/2717] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:38 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:38.872716 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:38.884068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bd8cd-ec0e-439e-bc1b-703c41b3ea98 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:38.986028 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:38.986870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:38.987458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:38.987740 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:38.988607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:38.991014 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.078655 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1354/2718] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:38 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:39.088526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:39.100784 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c0047-e335-4839-98b6-6d5a420f092a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:39.107090 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:39.108995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.109402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.113982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.113982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:39.113982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.128922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1365/2719] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:39.129588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:39.140502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767e641-7b5e-4862-a6d1-ad44fd9db9af admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:39.145237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:39.145916 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.146199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.149535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.149535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:39.149535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff894d-d7fb-4cd3-a238-2f297ade0456 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.162745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1355/2720] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:39.167302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:39.181751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d3173-97c5-4435-864a-02d6ae58cdc5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:39.186458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:39.187438 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.187720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.187991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] PATH_INFO: `/v3/projects/ed73235ecb404e1fb5043d1debc8f826/users/20175f26d0dc439ab3d29c12425ee88d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.205713 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed73235ecb404e1fb5043d1debc8f826, user_id=20175f26d0dc439ab3d29c12425ee88d, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:39.208484 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.271693 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1366/2721] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:39 2022] PUT /identity/v3/projects/ed73235ecb404e1fb5043d1debc8f826/users/20175f26d0dc439ab3d29c12425ee88d/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:39.283127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.283421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.283695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.317445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] MFA Rules not processed for user `20175f26d0dc439ab3d29c12425ee88d`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:39.318621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:39.417444 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1356/2722] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:39.421148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:39.479810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:39.501234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07010a-6e51-4506-a318-fde846169006 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:39.506167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:39.506909 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.507235 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.507519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.508210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:39.510189 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.804003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1367/2723] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:39 2022] POST /identity/v3/projects => generated 381 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:39.808187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:39.820034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5da1e-e006-450c-9386-8247c0f2bbf0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:39.882072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:39.888982 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:39.890034 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:39.890460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:39.890914 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:39.891753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:39.896746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:39.999259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1357/2724] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:39 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:40.002591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:40.013920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f4dcc-9390-4e4a-b7b0-d509360c935c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:40.020416 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:40.021389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.021771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.022154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.023040 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:40.024753 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:40.042131 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1368/2725] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:40.047162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:40.055497 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7729f88a-a60b-4e2a-b683-7378b47733f3 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:40.063849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:40.064791 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.065081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.065406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] PATH_INFO: `/v3/projects/fae688c3b1324aa8847981fb8572a1a7/users/019004e7d03c49baa8b238f8b6e634df/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.095480 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae688c3b1324aa8847981fb8572a1a7, user_id=019004e7d03c49baa8b238f8b6e634df, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:40.098408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:40.180236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1358/2726] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:40 2022] PUT /identity/v3/projects/fae688c3b1324aa8847981fb8572a1a7/users/019004e7d03c49baa8b238f8b6e634df/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:40.184169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:40.198838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe44689-bfb0-4c3e-989a-50e8228aa6af admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:40.302926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:40.303989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.304447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.304725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.305494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:40.309496 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3357d-28e0-46a9-a7fc-7c757ec71870 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:40.320927 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1369/2727] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:40.324810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:40.339274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a93479-7c3f-4714-b62d-e97784cac2de admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:40.344570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:40.345547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.345906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.353745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] PATH_INFO: `/v3/projects/fae688c3b1324aa8847981fb8572a1a7/users/019004e7d03c49baa8b238f8b6e634df/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.353745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae688c3b1324aa8847981fb8572a1a7, user_id=019004e7d03c49baa8b238f8b6e634df, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:40.353745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:40.375781 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1359/2728] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:40 2022] PUT /identity/v3/projects/fae688c3b1324aa8847981fb8572a1a7/users/019004e7d03c49baa8b238f8b6e634df/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:40.378501 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.378806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.379088 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.416734 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] MFA Rules not processed for user `019004e7d03c49baa8b238f8b6e634df`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:40.418627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:40.513475 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1370/2729] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:40.523477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:40.525649 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:40.600545 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2b4d1-b289-461b-8793-ea2dd7dee5bf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:40.604295 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:40.604935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:40.605216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:40.605524 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:40.619131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:40.620592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e5a15-19ad-43ce-a378-08f5657bdd2c service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:40.635282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1360/2730] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:41.210712 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:41.267309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:41.293534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97847bd-8c2c-4595-a326-0747c9bb9071 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:41.300440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:41.301424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:41.301710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:41.301988 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] PATH_INFO: `/v3/users/20175f26d0dc439ab3d29c12425ee88d` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:41.303249 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20175f26d0dc439ab3d29c12425ee88d)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:41.308766 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:41.466454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20175f26d0dc439ab3d29c12425ee88d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:41.489283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20175f26d0dc439ab3d29c12425ee88d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:41.556960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20175f26d0dc439ab3d29c12425ee88d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:41.557955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20175f26d0dc439ab3d29c12425ee88d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:41.558903 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20175f26d0dc439ab3d29c12425ee88d'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:41.573180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1371/2731] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:41 2022] DELETE /identity/v3/users/20175f26d0dc439ab3d29c12425ee88d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:41.577995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215625-9215-498a-9dde-5ee173008403 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:41.578499 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215625-9215-498a-9dde-5ee173008403 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:41.578608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41215625-9215-498a-9dde-5ee173008403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:41.597323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-41215625-9215-498a-9dde-5ee173008403 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:41.598538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-41215625-9215-498a-9dde-5ee173008403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:41.666328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1361/2732] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:41.677433 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:41.679001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:41.743139 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4e20b3-008c-4fb9-aa9e-e31ab0f56112 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:41.747198 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:41.747842 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:41.748125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:41.748510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:41.760178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:41.761692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:41.772884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1372/2733] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:42.291142 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215625-9215-498a-9dde-5ee173008403 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:42.292616 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-41215625-9215-498a-9dde-5ee173008403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:42.307575 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41215625-9215-498a-9dde-5ee173008403 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:42.315127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:42.318463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:42.318463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:42.318463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] PATH_INFO: `/v3/projects/ed73235ecb404e1fb5043d1debc8f826` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:42.318463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed73235ecb404e1fb5043d1debc8f826)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:42.319784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:42.450557 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:42.452902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed73235ecb404e1fb5043d1debc8f826', 'request_id': 'req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:42.459241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed73235ecb404e1fb5043d1debc8f826', 'request_id': 'req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:42.465123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed73235ecb404e1fb5043d1debc8f826', 'request_id': 'req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:42.938023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] The token cache is being invalidate because project ed73235ecb404e1fb5043d1debc8f826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:42.953706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:42.953706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:42.953706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1362/2734] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:42 2022] DELETE /identity/v3/projects/ed73235ecb404e1fb5043d1debc8f826 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:42.954032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:42.954697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3f5cd-050a-4e5d-88b2-87a5829f8073 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:43.012652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:43.013577 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:43.013891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:43.014272 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] PATH_INFO: `/v3/users/019004e7d03c49baa8b238f8b6e634df` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:43.015462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] RBAC: Authorizing `identity:delete_user(user_id=019004e7d03c49baa8b238f8b6e634df)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:43.017458 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:43.018934 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:43.218220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '019004e7d03c49baa8b238f8b6e634df'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:43.237602 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '019004e7d03c49baa8b238f8b6e634df'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:43.310171 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '019004e7d03c49baa8b238f8b6e634df'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:43.310856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '019004e7d03c49baa8b238f8b6e634df'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:43.311777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2a9cbd0b-5cc3-4a6b-8555-4d8d2074c07e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '019004e7d03c49baa8b238f8b6e634df'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:43.331302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1373/2735] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:42 2022] DELETE /identity/v3/users/019004e7d03c49baa8b238f8b6e634df => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:43.828189 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:43.830006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:43.852370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee316b1-3ca2-42fa-80a6-9f8ca97b67b8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:43.951472 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:43.953837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:43.954283 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:43.954715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] PATH_INFO: `/v3/projects/fae688c3b1324aa8847981fb8572a1a7` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:43.959020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae688c3b1324aa8847981fb8572a1a7)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:43.959020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.097363 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae688c3b1324aa8847981fb8572a1a7', 'request_id': 'req-b135e8f9-6702-4455-8498-573e719889f6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:44.107228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae688c3b1324aa8847981fb8572a1a7', 'request_id': 'req-b135e8f9-6702-4455-8498-573e719889f6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:44.114299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae688c3b1324aa8847981fb8572a1a7', 'request_id': 'req-b135e8f9-6702-4455-8498-573e719889f6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:44.207024 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] The token cache is being invalidate because project fae688c3b1324aa8847981fb8572a1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:44.207605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:44.208488 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-b135e8f9-6702-4455-8498-573e719889f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:44.210429 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1363/2736] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:43 2022] DELETE /identity/v3/projects/fae688c3b1324aa8847981fb8572a1a7 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:44.216536 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.218338 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.218634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.240240 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:44.243203 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:44.326964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1374/2737] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:44:44.328669 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.328990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.329564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.353069 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:44.354365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:44.369354 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1364/2738] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:44.370598 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.383363 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133a9d7c-6cf3-4995-8b7e-dc4e123a5178 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.389696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.390353 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.390642 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.390922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.391661 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:44.392000 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.393641 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.412452 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1375/2739] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:44:44.416777 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.431003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31142-5870-44a7-a0e4-ae47251dfc9a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.436783 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.437493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.438045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.438336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.439089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.442609 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.533075 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1365/2740] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:44 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:44.536949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.554095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9ebb-aa75-438d-832e-c04c96cd9a20 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.624665 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.625390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.625678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.625955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.626654 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.628799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.641165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:44.743018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1376/2741] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:44 2022] POST /identity/v3/users => generated 292 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:44.744389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.756228 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f94225-d226-48ae-b5b6-608b11bf8dd3 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.760823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.761512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.761794 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.762068 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.762784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.765153 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.778067 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1366/2742] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:44.784690 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.796653 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b281ff4-ffe2-4557-8fa5-83fd8eda473c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.801904 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.802752 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.803143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.803565 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.804704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.808079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cff91ff-9548-420e-86cd-2a44d20b074d admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.822682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1377/2743] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:44:44.826534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:44.837909 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f573f1-59f1-4b7f-911f-9f069ad17650 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:44.843645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:44.844554 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.844841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.845123 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] PATH_INFO: `/v3/projects/0f59447c252f42edb32db5420f602f78/users/06de9e62d75b44feadbad5f8d31c8ee3/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.863984 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f59447c252f42edb32db5420f602f78, user_id=06de9e62d75b44feadbad5f8d31c8ee3, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:44.866736 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:44.957293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1367/2744] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:44 2022] PUT /identity/v3/projects/0f59447c252f42edb32db5420f602f78/users/06de9e62d75b44feadbad5f8d31c8ee3/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:44.961939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:44.964947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:44.964947 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:44.999678 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] MFA Rules not processed for user `06de9e62d75b44feadbad5f8d31c8ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:45.001750 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:45.098115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1378/2745] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:45.117989 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:45.119711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:45.126134 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:45.190501 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06165ff6-2857-4e61-9d29-3fa1d2fb1a7f admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:45.194436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:45.195166 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:45.195644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:45.195931 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:45.210836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:45.212860 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:45.224145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1368/2746] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:52.565187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:52.591562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:52.594169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:52.631376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb33080-af44-4d71-90d5-d64c4a2a7a54 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:52.635913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:52.636838 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:52.637133 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:52.637440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] PATH_INFO: `/v3/users/06de9e62d75b44feadbad5f8d31c8ee3` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:52.638625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06de9e62d75b44feadbad5f8d31c8ee3)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:52.641349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:52.652600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f77e8-5e60-49b7-bfe1-8ed79131b8c4 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:52.656390 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:52.657037 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:52.657364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:52.657644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:52.659408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:52.669162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:52.670604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf3ed-2061-4735-b1bd-846b199743fd service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:52.678553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1369/2747] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:44:52.815179 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06de9e62d75b44feadbad5f8d31c8ee3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:52.827148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06de9e62d75b44feadbad5f8d31c8ee3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:52.910160 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06de9e62d75b44feadbad5f8d31c8ee3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:52.911097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06de9e62d75b44feadbad5f8d31c8ee3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:52.911935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-2e59b6e4-618f-4d9f-8c09-1f49e7995b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06de9e62d75b44feadbad5f8d31c8ee3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:52.918610 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:52.927701 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1379/2748] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:52 2022] DELETE /identity/v3/users/06de9e62d75b44feadbad5f8d31c8ee3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:52.932334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:52.932727 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:52.933103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:52.951726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:52.953846 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.004495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d183-a23d-450b-bf19-707df910538c None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.005063 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d183-a23d-450b-bf19-707df910538c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.005918 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6d183-a23d-450b-bf19-707df910538c None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.008128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1380/2749] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:44:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:44:53.016689 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc383-c87b-49a1-9192-232715134f17 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.017154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc383-c87b-49a1-9192-232715134f17 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.017471 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc383-c87b-49a1-9192-232715134f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.023278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1370/2750] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:44:53.030118 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:53.032668 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.045436 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-26dcc383-c87b-49a1-9192-232715134f17 None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:53.047769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-26dcc383-c87b-49a1-9192-232715134f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.088880 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:53.093212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf27e2-df3d-442a-9ca3-c10ce8480850 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:53.096897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:53.097605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.097887 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.098158 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.107103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:53.109370 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:53.119232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1371/2751] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:44:53.129011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1381/2752] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:44:53.141469 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:53.143041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.201764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020774e4-c103-4ee1-a2e2-14e46d6daa95 service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:53.205808 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:53.206456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.206743 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.207019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.217965 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:53.219412 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ded863-6c62-4333-8dd9-83a794251a34 service glance] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:53.230502 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1372/2753] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:53.465856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.466152 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.466437 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.468790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1382/2754] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 03:44:53.473780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.474026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.474330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.492973 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] MFA Rules not processed for user `b4c5841ec0bd4e16b90e6b1c42ff0df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:53.494212 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.501873 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1373/2755] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:53.512502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:53.514450 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.529180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46effcd5-2be0-452c-9877-5883f9f8fb80 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:53.532593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401be637-98ac-47de-8721-483949620933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:53.533243 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be637-98ac-47de-8721-483949620933 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.533562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be637-98ac-47de-8721-483949620933 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.533843 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401be637-98ac-47de-8721-483949620933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.541647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be637-98ac-47de-8721-483949620933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:53.543157 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401be637-98ac-47de-8721-483949620933 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:53.552530 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1383/2756] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:53.592099 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:53.594960 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.610345 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0071d8-8265-46f4-9260-031e84484c25 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:53.615583 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:53.616460 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.616776 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.617058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] PATH_INFO: `/v3/projects/0f59447c252f42edb32db5420f602f78` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.618322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f59447c252f42edb32db5420f602f78)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:53.620269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:53.664828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c95c5-1f7c-4b4b-9b0f-e775b5b13412 None None] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.665401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c95c5-1f7c-4b4b-9b0f-e775b5b13412 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.665529 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c95c5-1f7c-4b4b-9b0f-e775b5b13412 None None] PATH_INFO: `/` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.666846 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1384/2757] 10.222.0.71 () {54 vars in 921 bytes} [Fri May 27 03:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 03:44:53.672925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.678567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.678567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.691786 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] MFA Rules not processed for user `17726b67d4d54d38be845acf03cbb664`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:53.692968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.702989 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1385/2758] 10.222.0.71 () {58 vars in 1018 bytes} [Fri May 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:44:53.713392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:53.724080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d9b37-6b4b-453a-9570-aeea96c1e396 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:53.727896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:53.730250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.730250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.730250 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.739814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:53.741291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43fa7d-315f-4ca7-854c-8b36853df415 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:53.744280 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f59447c252f42edb32db5420f602f78', 'request_id': 'req-d9ec97c9-c7db-4471-890a-20a7a9334ceb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:53.750704 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f59447c252f42edb32db5420f602f78', 'request_id': 'req-d9ec97c9-c7db-4471-890a-20a7a9334ceb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:53.752775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1386/2759] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:44:53.758920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f59447c252f42edb32db5420f602f78', 'request_id': 'req-d9ec97c9-c7db-4471-890a-20a7a9334ceb'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:53.852080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] The token cache is being invalidate because project 0f59447c252f42edb32db5420f602f78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:53.852483 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:53.854109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d9ec97c9-c7db-4471-890a-20a7a9334ceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:53.855853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1374/2760] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:53 2022] DELETE /identity/v3/projects/0f59447c252f42edb32db5420f602f78 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:53.901937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.901937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.901937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.901937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:53.901937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.948108 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1387/2761] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:53.956250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:53.956544 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:53.956833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:53.975400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:53.976600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:53.985564 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1375/2762] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:53.989755 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.000527 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802190dc-2d35-4a61-b361-c6da4a5ad27c None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.005156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.005901 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.006191 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.006474 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.007197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80541) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:44:54.007506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.009216 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.024400 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1388/2763] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:44:54.025421 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.034835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9269a21-a487-4c68-9a62-d8710b2048c1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.039990 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.040646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.040930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.041208 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.041955 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.043905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.156988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1376/2764] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:44:54 2022] POST /identity/v3/projects => generated 359 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:44:54.158219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.169572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff8338-d790-4088-a493-481d28c56240 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.216187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:54.239559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.240266 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.240547 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.240836 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] PATH_INFO: `/v3/users` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.241557 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.243447 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.327175 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1389/2765] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:44:54 2022] POST /identity/v3/users => generated 280 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:44:54.331121 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.341673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad06bd-c13c-4633-ac45-71df16a573bf admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.347276 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.347944 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.348314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.348595 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.349401 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.351006 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.363576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1377/2766] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:54.374937 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.385095 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e05120-fe94-4180-b2b2-04398c305c72 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.389847 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.390517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.390801 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.391078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.391803 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.393417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce232d2-618d-4406-b5d9-61436ebb111f admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.403925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1390/2767] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:44:54.409785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.420201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964fcca-ffa6-4aca-a6d9-742a4fe7b928 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.425553 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.426438 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.426732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.427060 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] PATH_INFO: `/v3/projects/d7c97c541563486589e977d6633f4916/users/064a9e98420a431aab71e8432d559f0e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.441392 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c97c541563486589e977d6633f4916, user_id=064a9e98420a431aab71e8432d559f0e, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.444036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.516254 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1378/2768] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:44:54 2022] PUT /identity/v3/projects/d7c97c541563486589e977d6633f4916/users/064a9e98420a431aab71e8432d559f0e/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:54.526805 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.527097 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.527373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.555132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] MFA Rules not processed for user `064a9e98420a431aab71e8432d559f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:54.556330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:54.624306 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1391/2769] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:54.667344 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.669113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:54.679481 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:54.728744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebebc76-3768-48fb-bc27-d11a933993a4 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.732615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.733328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.733673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.733952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.742977 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.744413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad1ee7-6036-4fdc-95da-980230ae7c29 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:54.753903 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1379/2770] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:54.769060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:54.837207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fdc83-fcf7-4989-95fd-184359d25b7b None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:54.843362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:54.844241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:54.844518 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:54.844790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] PATH_INFO: `/v3/users/064a9e98420a431aab71e8432d559f0e` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:54.846019 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064a9e98420a431aab71e8432d559f0e)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:54.847932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:55.095221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064a9e98420a431aab71e8432d559f0e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:55.097010 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:55.107254 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064a9e98420a431aab71e8432d559f0e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:55.218882 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064a9e98420a431aab71e8432d559f0e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:55.219740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064a9e98420a431aab71e8432d559f0e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:55.220567 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064a9e98420a431aab71e8432d559f0e'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:55.234628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1392/2771] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:44:54 2022] DELETE /identity/v3/users/064a9e98420a431aab71e8432d559f0e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:44:55.239199 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:55.239525 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:55.239828 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:55.259186 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:55.260439 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:55.325493 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1380/2772] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:55.335226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:55.336628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:55.404682 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e680d-6fdc-497e-b0df-b1d5d6f060c5 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:55.408537 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:55.409186 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:55.409539 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:55.409812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:55.419697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:55.421896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41562fae-e4eb-4563-b15e-ece3a24c1342 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:55.432026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1393/2773] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:44:55.853150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:55.853150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:55.863969 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d6d83-0dfc-4676-9d5b-45288126eec9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:55.868731 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:55.869630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:55.869943 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:55.870218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] PATH_INFO: `/v3/projects/d7c97c541563486589e977d6633f4916` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:55.871408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c97c541563486589e977d6633f4916)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:55.873349 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:56.009292 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c97c541563486589e977d6633f4916', 'request_id': 'req-65ede98a-2c20-4866-8d45-f53902344480'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:56.016071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c97c541563486589e977d6633f4916', 'request_id': 'req-65ede98a-2c20-4866-8d45-f53902344480'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:56.021935 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c97c541563486589e977d6633f4916', 'request_id': 'req-65ede98a-2c20-4866-8d45-f53902344480'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:56.137308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] The token cache is being invalidate because project d7c97c541563486589e977d6633f4916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:44:56.137560 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:56.138172 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:44:56.139712 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1381/2774] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:44:55 2022] DELETE /identity/v3/projects/d7c97c541563486589e977d6633f4916 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:44:57.353761 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7d48-5a6c-47d7-92bb-4a4f6a00d865 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:57.354231 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7d48-5a6c-47d7-92bb-4a4f6a00d865 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:57.354379 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f7d48-5a6c-47d7-92bb-4a4f6a00d865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:57.371593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-567f7d48-5a6c-47d7-92bb-4a4f6a00d865 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:44:57.372815 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-567f7d48-5a6c-47d7-92bb-4a4f6a00d865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:57.428251 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1394/2775] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:44:57.440999 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:44:57.442433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:44:57.477201 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:44:57.512801 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ede98a-2c20-4866-8d45-f53902344480 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:44:57.518328 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:44:57.518974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:44:57.519266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:44:57.519547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:44:57.528020 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:44:57.529644 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:44:57.538974 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1382/2776] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:45:07.421038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=62,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:07.658190 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=17 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:14.160879 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:14.161639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:14.161639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:14.181890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:45:14.183085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:14.192402 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1395/2777] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:45:14.207461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:14.216244 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457026b-9e15-49e2-b55d-1cfe8bb4a448 service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:14.221661 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:14.222310 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:14.222594 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:14.222872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:14.231127 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:14.232696 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:14.241762 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1383/2778] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:45:16.068252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:16.069703 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:16.126080 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e11f06-0c9c-4e69-9694-582958091049 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:16.130261 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:16.130897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:16.131177 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:16.131451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:16.133185 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:16.194795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:16.196141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:16.206115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1396/2779] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:45:23.334293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:23.335885 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:23.350563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38020264-40fb-4580-a8cb-723a007a92f5 service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:23.355057 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:23.357111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:23.357111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:23.357111 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] PATH_INFO: `/v3/users/1136b22863db49eba41ea8dfded8c750` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:23.357643 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1136b22863db49eba41ea8dfded8c750)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:23.359563 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:23.558754 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1136b22863db49eba41ea8dfded8c750'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:23.559482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1136b22863db49eba41ea8dfded8c750'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:23.571753 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1136b22863db49eba41ea8dfded8c750'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:23.663683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1136b22863db49eba41ea8dfded8c750'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:23.664337 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1136b22863db49eba41ea8dfded8c750'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:23.678029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1384/2780] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:45:23 2022] DELETE /identity/v3/users/1136b22863db49eba41ea8dfded8c750 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:45:23.939592 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:23.951299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3e49b-5738-4123-bd0b-c77757848433 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:24.009173 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:24.010065 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:24.010381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:24.010646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] PATH_INFO: `/v3/projects/768052d3698e483584138b97ac418580` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:24.011811 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=768052d3698e483584138b97ac418580)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:24.013763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:24.130434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:24.133226 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768052d3698e483584138b97ac418580', 'request_id': 'req-3b46aafa-dc39-403c-99a2-ae3ce04f9476'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.139516 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768052d3698e483584138b97ac418580', 'request_id': 'req-3b46aafa-dc39-403c-99a2-ae3ce04f9476'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.145983 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768052d3698e483584138b97ac418580', 'request_id': 'req-3b46aafa-dc39-403c-99a2-ae3ce04f9476'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.222628 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] The token cache is being invalidate because project 768052d3698e483584138b97ac418580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:45:24.222912 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.223535 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.225064 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1397/2781] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:45:23 2022] DELETE /identity/v3/projects/768052d3698e483584138b97ac418580 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:45:24.229237 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:24.230656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:24.243540 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab7dfa6-8f4b-4146-8354-847589e6543a admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:24.299670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:24.300641 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:24.300920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:24.301196 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] PATH_INFO: `/v3/users/f21319d8a0b542ceade2e4e3a8eb0f87` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:24.302535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21319d8a0b542ceade2e4e3a8eb0f87)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:24.304473 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:24.517012 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21319d8a0b542ceade2e4e3a8eb0f87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.517713 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21319d8a0b542ceade2e4e3a8eb0f87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.528629 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:24.530866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21319d8a0b542ceade2e4e3a8eb0f87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.601038 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21319d8a0b542ceade2e4e3a8eb0f87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.601695 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-a91ca0af-c381-4de5-9878-46285a1b9dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21319d8a0b542ceade2e4e3a8eb0f87'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:24.615433 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1385/2782] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:45:24 2022] DELETE /identity/v3/users/f21319d8a0b542ceade2e4e3a8eb0f87 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:45:24.887542 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:45:24.889053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:24.902716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46aafa-dc39-403c-99a2-ae3ce04f9476 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:45:24.961697 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:45:24.962558 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:24.962839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:24.963112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] PATH_INFO: `/v3/projects/4fd0b44fe4bd4a61a8976812b353af93` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:24.964283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd0b44fe4bd4a61a8976812b353af93)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:45:24.966287 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:45:25.093352 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd0b44fe4bd4a61a8976812b353af93', 'request_id': 'req-1bf82a4a-ac22-420b-9226-57801b854ded'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:25.100145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd0b44fe4bd4a61a8976812b353af93', 'request_id': 'req-1bf82a4a-ac22-420b-9226-57801b854ded'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:25.105621 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd0b44fe4bd4a61a8976812b353af93', 'request_id': 'req-1bf82a4a-ac22-420b-9226-57801b854ded'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:25.188234 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] The token cache is being invalidate because project 4fd0b44fe4bd4a61a8976812b353af93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:45:25.188454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:25.189114 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:45:25.190728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1398/2783] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:45:24 2022] DELETE /identity/v3/projects/4fd0b44fe4bd4a61a8976812b353af93 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:45:34.657448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:35.185032 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:45:53.688263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5821fc-a24a-4000-aca1-d94574954475 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:45:53.688836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5821fc-a24a-4000-aca1-d94574954475 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:45:53.688836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5821fc-a24a-4000-aca1-d94574954475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:45:53.708054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fc5821fc-a24a-4000-aca1-d94574954475 None None] MFA Rules not processed for user `e1de9e641be64405ba746e9408108e53`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:45:53.709332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fc5821fc-a24a-4000-aca1-d94574954475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:45:53.770219 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1386/2784] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:45:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:46:03.764051 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=25 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:46:13.500646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:46:13.502129 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:46:13.574894 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82a4a-ac22-420b-9226-57801b854ded admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:46:13.580371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:46:13.581027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:46:13.581342 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:46:13.581626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:46:13.583384 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:46:13.596030 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:46:13.597652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:46:13.608324 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1399/2785] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:46:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:46:23.603298 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=32 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:46:59.250442 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535f73-9f70-4d00-a8bd-dce16d46d4d4 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:46:59.250930 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535f73-9f70-4d00-a8bd-dce16d46d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:46:59.251027 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94535f73-9f70-4d00-a8bd-dce16d46d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:46:59.268764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-94535f73-9f70-4d00-a8bd-dce16d46d4d4 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:46:59.271807 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-94535f73-9f70-4d00-a8bd-dce16d46d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:46:59.328001 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1387/2786] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:46:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:46:59.495123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:46:59.496540 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:46:59.566018 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca00f5-f374-45c5-851f-f706a55cf53f service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:46:59.571093 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:46:59.571739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:46:59.572020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:46:59.572296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:46:59.580396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:46:59.581960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:46:59.590716 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1400/2787] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:46:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:47:09.319285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=25 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:47:09.591996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=32 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:47:22.120662 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8a40-2be1-4612-b296-a851722527c0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:47:22.121140 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8a40-2be1-4612-b296-a851722527c0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:47:22.121249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e8a40-2be1-4612-b296-a851722527c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:47:22.138739 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-cb7e8a40-2be1-4612-b296-a851722527c0 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:47:22.140029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-cb7e8a40-2be1-4612-b296-a851722527c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:47:22.147413 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1388/2788] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:47:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:47:22.160054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:47:22.171255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38a3bd-598a-4eb3-a695-2a5833c106e3 service swift] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:47:22.176161 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:47:22.176792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:47:22.177073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:47:22.177388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:47:22.185466 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:47:22.187023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:47:22.195014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1401/2789] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:47:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:47:32.133543 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:47:32.191725 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=6 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:47:35.936330 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:47:35.937002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:47:35.937002 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:47:35.954971 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:47:35.956168 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:47:35.963311 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1389/2790] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:47:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:47:35.976221 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:47:35.987079 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f609f9-d2dc-4bc1-b441-13dedd2a7872 service swift] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:47:35.992052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:47:35.992688 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:47:35.992976 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:47:35.993286 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:47:36.002025 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:47:36.003596 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:47:36.012310 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1402/2791] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:47:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:47:45.949785 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:47:46.008393 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=6 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:13.752461 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:13.753866 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:13.809285 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73293952-d7da-4bea-85d6-6008b2d927d2 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:13.812732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:13.813398 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:13.813692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:13.813967 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:13.815778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:13.826864 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:13.828279 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:13.837827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1390/2792] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:15.201158 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:15.202608 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:15.260252 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a380a39-e711-4327-88d3-a852663fbffd service swift] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:15.264048 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:15.264696 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:15.264982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:15.265275 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:15.267102 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:15.328566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:15.330029 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:15.340463 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1403/2793] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:18.776374 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:18.777957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:18.793949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d8fd1-f98a-47c4-ac96-7d676ba0b334 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:18.798751 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:18.799841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:18.800247 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:18.800534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] PATH_INFO: `/v3/users/e1de9e641be64405ba746e9408108e53` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:18.801851 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1de9e641be64405ba746e9408108e53)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:18.804097 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:19.000170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1de9e641be64405ba746e9408108e53'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.000759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1de9e641be64405ba746e9408108e53'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.013250 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1de9e641be64405ba746e9408108e53'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.072178 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1de9e641be64405ba746e9408108e53'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.072792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-d4b12f99-d31d-4bb1-bbb2-516587c2ec19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1de9e641be64405ba746e9408108e53'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.086517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1391/2794] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:48:18 2022] DELETE /identity/v3/users/e1de9e641be64405ba746e9408108e53 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:48:19.342391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:19.354397 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2aebb-97ac-4ef9-aefa-07e20c5488e4 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:19.413864 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:19.414757 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:19.415043 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:19.415320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] PATH_INFO: `/v3/projects/e64d3975127c49b387c4f167cd3f269a` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:19.416505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e64d3975127c49b387c4f167cd3f269a)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:19.418454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:19.553322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e64d3975127c49b387c4f167cd3f269a', 'request_id': 'req-8fa2f70f-8206-4efa-ae98-8b07016193e3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.555790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:19.560212 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e64d3975127c49b387c4f167cd3f269a', 'request_id': 'req-8fa2f70f-8206-4efa-ae98-8b07016193e3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.565774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e64d3975127c49b387c4f167cd3f269a', 'request_id': 'req-8fa2f70f-8206-4efa-ae98-8b07016193e3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.671045 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] The token cache is being invalidate because project e64d3975127c49b387c4f167cd3f269a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:48:19.671332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.671948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-8fa2f70f-8206-4efa-ae98-8b07016193e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:48:19.673631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1404/2795] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:48:19 2022] DELETE /identity/v3/projects/e64d3975127c49b387c4f167cd3f269a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 03:48:19.679273 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4391-5278-4509-865f-e1691559788a None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:19.679691 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4391-5278-4509-865f-e1691559788a None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:19.680080 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec4391-5278-4509-865f-e1691559788a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:19.699266 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-52ec4391-5278-4509-865f-e1691559788a None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:48:19.700478 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-52ec4391-5278-4509-865f-e1691559788a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:19.760138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1392/2796] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:48:19.767830 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:19.768121 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:19.768401 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:19.787038 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:48:19.788888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:19.796679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1405/2797] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:48:19.800761 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4391-5278-4509-865f-e1691559788a None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:19.811215 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec4391-5278-4509-865f-e1691559788a None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:19.815770 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:19.820026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:19.820026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:19.820026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:19.820026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:48:19.820026 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:19.820778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:19.833039 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1393/2798] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:48:19.837448 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:19.846905 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f94537-77c0-4b0a-83fe-e069ce1ac596 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:19.852120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:19.852769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:19.853053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:19.853364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:19.854062 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:19.860517 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:19.977568 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1406/2799] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:48:19 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:48:19.982263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:19.987827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:19.997957 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbd6d2-07fa-48d0-a9e0-5776fef9c0b8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:20.049065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:20.049766 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.050054 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.050357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.051016 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:20.052920 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:20.152485 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1394/2800] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:48:19 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:48:20.156814 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:20.168748 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c11a1-c453-4467-a2b2-710338a5f4d6 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:20.173981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:20.174839 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.175123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.175404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.176125 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:20.177767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:20.190183 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1407/2801] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:48:20.195136 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:20.205597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d4c23-2933-49ed-bd8f-9c5eae14c9ed admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:20.210913 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:20.211171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.211468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.211745 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.212467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:20.214269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c10a68-1f55-43de-977f-eced5987b232 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:20.224764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1395/2802] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:48:20.229233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:20.239299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adfd0d-dba3-42fa-9a1c-6a517f18074e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:20.244389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:20.245339 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.245627 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.245907 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] PATH_INFO: `/v3/projects/a194a9d6aa0242ddb7d74e6738f9cdda/users/43423b596be340c7a38d469636779ca6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.260981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a194a9d6aa0242ddb7d74e6738f9cdda, user_id=43423b596be340c7a38d469636779ca6, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:20.263698 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:20.328605 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1408/2803] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:48:20 2022] PUT /identity/v3/projects/a194a9d6aa0242ddb7d74e6738f9cdda/users/43423b596be340c7a38d469636779ca6/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:48:20.333884 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51af8-7e84-4f0e-ae26-5b82e7c67e77 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.334182 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51af8-7e84-4f0e-ae26-5b82e7c67e77 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.334466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51af8-7e84-4f0e-ae26-5b82e7c67e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.353043 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-8ad51af8-7e84-4f0e-ae26-5b82e7c67e77 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:48:20.356841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8ad51af8-7e84-4f0e-ae26-5b82e7c67e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:20.413681 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1396/2804] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:48:20.423238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:20.424945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:20.484405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4714c6-0ee7-40f8-8adb-e00ee59e0658 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:20.487869 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:20.488510 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:20.488792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:20.489071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:20.498890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:20.500377 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:20.509956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1409/2805] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:25.762623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4aaae-0c9b-4c4e-86c0-57bb9b523f17 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:25.763185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4aaae-0c9b-4c4e-86c0-57bb9b523f17 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:25.763185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4aaae-0c9b-4c4e-86c0-57bb9b523f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:25.795978 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-13b4aaae-0c9b-4c4e-86c0-57bb9b523f17 None None] MFA Rules not processed for user `43423b596be340c7a38d469636779ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:48:25.797400 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-13b4aaae-0c9b-4c4e-86c0-57bb9b523f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:25.873045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1397/2806] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:48:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:48:25.882760 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:25.884461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:25.966330 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffca095-1c6a-4122-a759-7a3f53b17f13 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:25.972213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:25.972868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:25.973154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:25.973461 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:25.983213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:25.984944 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:25.994629 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1410/2807] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:28.371408 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:28.371910 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:28.372008 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:28.391523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] MFA Rules not processed for user `43423b596be340c7a38d469636779ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:48:28.392774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:28.400541 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1398/2808] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:48:28.439762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:28.441239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:28.449376 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:28.502462 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73661e4c-b0cc-4e30-810c-93df08fadaf4 service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:28.506588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:28.507283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:28.507572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:28.507856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:28.509687 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:28.524996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:28.526664 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:28.539392 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1411/2809] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:29.363383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:29.364899 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:29.367788 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:29.372734 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:29.380765 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dc76e-1361-4846-81c7-b848f72fca7d service glance] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:29.386055 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:29.386728 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:29.387017 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:29.387299 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:29.389144 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:29.415150 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:29.416763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:29.432845 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1412/2810] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:29.447426 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb02d-a556-4d3e-b5b3-9c0cda686580 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:29.452607 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:29.453286 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:29.453587 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:29.453865 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:29.455795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:29.469535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:29.470359 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdaf09-17aa-42f6-bf17-b55cdf4dbe8d service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:29.482436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1399/2811] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:32.762454 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:48:32.764348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:32.776219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcda53-d149-4794-895f-bae10e212148 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:48:32.780609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:48:32.781695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:48:32.781695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:48:32.781928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:48:32.783877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:48:32.797639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:48:32.799099 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:48:32.808939 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1413/2812] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:48:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:48:39.505780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=30 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:48:42.805123 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=36 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:49:23.839780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:49:23.843072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:49:23.843072 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:49:23.859353 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] MFA Rules not processed for user `43423b596be340c7a38d469636779ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:49:23.860598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:23.867477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1400/2813] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:49:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:49:24.168559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:49:24.177533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842b1737-4c95-40c8-a1ec-4cabe6d4ab7d service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:49:24.181207 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:49:24.181884 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:49:24.182169 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:49:24.182451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:49:24.184214 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:24.194499 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:49:24.195917 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:49:24.205799 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1414/2814] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:49:28.214300 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:49:28.216729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:28.234778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59665f-f699-4a0d-a36e-ff2ce32672d6 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:49:28.240961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:49:28.241657 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:49:28.241946 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:49:28.242226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:49:28.244050 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:28.257850 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:49:28.259462 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:49:28.271953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1401/2815] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:49:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:49:33.188657 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:49:33.201741 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b25a20-308c-47a1-b4fb-8abd971ed220 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:49:33.208322 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:49:33.208956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:49:33.209241 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:49:33.209548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:49:33.211307 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:33.224414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:49:33.226047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c5969-45e1-4cd3-b8c1-7d2381739d85 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:49:33.236370 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1415/2816] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:49:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:49:36.102624 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:49:36.115314 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6354d-a017-42a2-8bcc-ab922c2698d6 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:49:36.121334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:49:36.122768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:49:36.123056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:49:36.123503 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:49:36.125621 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:49:36.138729 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:49:36.140308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:49:36.152281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1402/2817] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:49:43.231942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=12 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:49:46.147646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=15 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:25.349238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:50:25.349877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:50:25.349877 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:50:25.378481 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] MFA Rules not processed for user `43423b596be340c7a38d469636779ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:50:25.379733 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:50:25.403178 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1416/2818] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:50:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:50:25.708052 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:50:25.746023 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a64e7f-d56e-4932-9d6d-704b90181ebc service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:50:25.749676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:50:25.750313 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:50:25.750600 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:50:25.750877 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:50:25.752698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:50:25.774459 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:50:25.775867 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb45cbc-5c84-458b-983d-10f2de5ece40 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:50:25.783792 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1403/2819] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:50:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:50:35.401188 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=15 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:50:35.780271 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=23 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:51:16.452359 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:51:16.481485 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c83530-2b19-47b1-98bd-5f38c1798051 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:51:16.486673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:51:16.487321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:51:16.487609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:51:16.487890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:51:16.489751 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:51:16.514145 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:51:16.515719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:51:16.525740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1417/2820] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:51:26.521441 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=18 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:51:31.103491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:51:31.104045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:51:31.104045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:51:31.121365 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] MFA Rules not processed for user `43423b596be340c7a38d469636779ca6`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:51:31.122565 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:51:31.129417 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1404/2821] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:51:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:51:41.116291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:40.325538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:40.336812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f21b7-06c2-423a-8268-854b28088a0e service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:40.341857 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:40.343020 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:40.343325 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:40.343606 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:40.345740 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:40.358505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:40.363197 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:40.371291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1418/2822] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:52:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:52:40.462073 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:40.493939 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380dca0-373d-4b03-8aac-d1e83fc5c023 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:40.498658 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:40.499537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:40.499825 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:40.500106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] PATH_INFO: `/v3/users/43423b596be340c7a38d469636779ca6` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:40.501381 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] RBAC: Authorizing `identity:delete_user(user_id=43423b596be340c7a38d469636779ca6)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:40.503302 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:40.704636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43423b596be340c7a38d469636779ca6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:40.705332 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43423b596be340c7a38d469636779ca6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:40.718487 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43423b596be340c7a38d469636779ca6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:40.775591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43423b596be340c7a38d469636779ca6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:40.776259 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-fa35a6a8-4135-4c73-af57-c21398a9568b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43423b596be340c7a38d469636779ca6'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:40.789436 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1405/2823] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:52:40 2022] DELETE /identity/v3/users/43423b596be340c7a38d469636779ca6 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:52:41.040153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.051116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715dc13-a0d9-4587-91e0-b2f17a17f5d0 service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.111037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.111954 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.112236 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.112511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] PATH_INFO: `/v3/projects/a194a9d6aa0242ddb7d74e6738f9cdda` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.113732 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a194a9d6aa0242ddb7d74e6738f9cdda)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.115859 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:41.223858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a194a9d6aa0242ddb7d74e6738f9cdda', 'request_id': 'req-7ed43c55-f7ff-4e75-805f-677e92c8bea0'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:41.230335 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a194a9d6aa0242ddb7d74e6738f9cdda', 'request_id': 'req-7ed43c55-f7ff-4e75-805f-677e92c8bea0'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:41.236578 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a194a9d6aa0242ddb7d74e6738f9cdda', 'request_id': 'req-7ed43c55-f7ff-4e75-805f-677e92c8bea0'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:41.331399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] The token cache is being invalidate because project a194a9d6aa0242ddb7d74e6738f9cdda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:52:41.332069 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:41.332269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-7ed43c55-f7ff-4e75-805f-677e92c8bea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:52:41.333829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1419/2824] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:52:41 2022] DELETE /identity/v3/projects/a194a9d6aa0242ddb7d74e6738f9cdda => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:52:41.338798 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.339098 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.339383 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.396216 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:41.397449 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:41.456667 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1406/2825] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:41.464345 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.464634 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.464911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.482417 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:41.484094 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:41.491943 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1420/2826] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:41.496022 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.506209 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022104b-1954-4c1c-89fa-8942afc71db5 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.510757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.511406 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.511687 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.511959 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.512675 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:52:41.512980 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.514605 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:41.526194 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1407/2827] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:52:41.530574 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.540204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e42e2-8a2a-45e9-a114-a4db94802f2d None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.544826 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.545519 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.546429 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.546675 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.547465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.549405 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:41.635897 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1421/2828] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:52:41 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:52:41.638224 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.648109 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cac75-e06b-462d-a82a-4feb1aa87ec6 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.658891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:41.836573 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.837151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.837466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.837742 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.838416 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.840308 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:41.935452 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1408/2829] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:52:41 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:52:41.940167 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.950534 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df04a94-7bc6-45fd-b69b-0235d952cd2e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.955187 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.955848 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.956132 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.956410 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.957164 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.958807 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:41.969563 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1422/2830] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:52:41.973555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:41.984278 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2b7f66-614d-4035-b17e-47a308845853 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:41.988811 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:41.989490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:41.989769 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:41.990040 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:41.990744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:41.992352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de104b86-92a1-46a0-9482-560cee08af52 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:42.002467 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1409/2831] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:52:42.006445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:42.016982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403868-1625-4a65-a256-76bb1c50581c admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:42.022196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:42.023071 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:42.023357 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:42.023633 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] PATH_INFO: `/v3/projects/bd2996e17c38425096392a2caf4cec28/users/efca4c8f83e7487cb44db309b7499514/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:42.038888 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2996e17c38425096392a2caf4cec28, user_id=efca4c8f83e7487cb44db309b7499514, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:42.041559 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:42.125115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1423/2832] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:52:42 2022] PUT /identity/v3/projects/bd2996e17c38425096392a2caf4cec28/users/efca4c8f83e7487cb44db309b7499514/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:52:42.130262 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c87-996b-42cf-ae41-9e3bd3c9c2f2 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:42.130561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c87-996b-42cf-ae41-9e3bd3c9c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:42.130845 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58636c87-996b-42cf-ae41-9e3bd3c9c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:42.148327 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-58636c87-996b-42cf-ae41-9e3bd3c9c2f2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:42.149555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-58636c87-996b-42cf-ae41-9e3bd3c9c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:42.207482 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1410/2833] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:42.217026 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:42.219057 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:42.224743 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:42.279691 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b4b7-e908-4fc3-ac35-dbfdf1a67884 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:42.283978 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:42.284616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:42.284900 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:42.285174 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:42.294995 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:42.298880 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:42.306584 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1424/2834] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:52:43.484630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:43.485173 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:43.485325 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:43.511958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] MFA Rules not processed for user `efca4c8f83e7487cb44db309b7499514`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:43.513174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:43.600747 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1411/2835] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:43.605505 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:43.615570 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f554ddf-99a8-43a4-a6ed-039dcbccaaf1 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:43.621583 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:43.622238 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:43.622550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:43.622829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:43.623526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:43.625777 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:43.707674 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1425/2836] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 03:52:43.711551 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:43.723411 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63321a9-7955-4f90-b029-2369b0f3283d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:43.741555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:43.779405 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:43.780138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:43.780427 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:43.781356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:43.783843 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:43.784056 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:43.901523 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1412/2837] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:52:43 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:52:43.907130 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:43.917609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce83d92-ec72-4867-863c-3d62691402a3 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:43.922255 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:43.922997 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:43.923316 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:43.923594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:43.924312 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:43.925940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:43.936739 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1426/2838] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:52:43.940882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:43.950726 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a714166-4e4e-4a6a-8571-d58e85cba4a0 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:43.956076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:43.956949 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:43.957230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:43.957542 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] PATH_INFO: `/v3/projects/80b9cdd611f347ef8b565dd6137136e2/users/ed90f66dfb7647e79630dfc10c90e0a0/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:43.972495 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b9cdd611f347ef8b565dd6137136e2, user_id=ed90f66dfb7647e79630dfc10c90e0a0, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:43.975210 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:44.055670 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1413/2839] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:52:43 2022] PUT /identity/v3/projects/80b9cdd611f347ef8b565dd6137136e2/users/ed90f66dfb7647e79630dfc10c90e0a0/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:52:44.059669 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:44.070718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b89ae-8ec3-4b2d-bc3d-55212ec2afb1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:44.127512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:44.128228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:44.128524 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:44.128804 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:44.129553 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:44.131153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3221a6c-4505-469e-a166-0098c958e978 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:44.141573 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1427/2840] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:52:44.145706 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:44.156150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf6ef7-6606-4f99-b8da-aed0e424acc8 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:44.160827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:44.161744 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:44.165420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:44.165420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] PATH_INFO: `/v3/projects/80b9cdd611f347ef8b565dd6137136e2/users/ed90f66dfb7647e79630dfc10c90e0a0/roles/ae01c02711814ca9b85abb5cb767fea3` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:44.165420 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=80b9cdd611f347ef8b565dd6137136e2, user_id=ed90f66dfb7647e79630dfc10c90e0a0, role_id=ae01c02711814ca9b85abb5cb767fea3)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:44.167013 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c87f397-f240-4709-93fb-f622b223ee6b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:44.177938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1414/2841] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:52:44 2022] PUT /identity/v3/projects/80b9cdd611f347ef8b565dd6137136e2/users/ed90f66dfb7647e79630dfc10c90e0a0/roles/ae01c02711814ca9b85abb5cb767fea3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:52:45.399692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:45.400210 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:45.400662 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:45.427856 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] MFA Rules not processed for user `ed90f66dfb7647e79630dfc10c90e0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:45.429077 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:45.490816 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:45.505667 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1428/2842] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:45.513131 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:45.513636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:45.513772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:45.532081 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] MFA Rules not processed for user `efca4c8f83e7487cb44db309b7499514`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:52:45.533375 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:45.588981 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1415/2843] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:52:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:52:45.600679 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:52:45.602812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:52:45.707366 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e2767-f5dc-4c36-af6f-ac9ad0cc42a4 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:52:45.713027 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:52:45.713710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:52:45.714001 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:52:45.714283 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:52:45.722981 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:52:45.724507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:52:45.733348 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1429/2844] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:52:55.582220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:52:55.747323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=49 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:07.125764 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:07.127229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:07.205672 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32afca1-d2e5-4791-8c5d-da662aedfa93 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:07.209539 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:07.210188 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:07.210477 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:07.210757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:07.219666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:07.221443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:07.239236 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1416/2845] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:53:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:53:17.234707 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=35 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:29.801673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:29.803115 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:29.875016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f8839-3ebb-4dfd-aaaa-51cd9f93542d service nova] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:29.879992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:29.880639 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:29.880924 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:29.881204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:29.883323 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:29.894810 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:29.896440 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:29.907951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1430/2846] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:53:30.598547 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:30.663778 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491bf76-13bd-41fe-bdfe-085264b56870 service cinder] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:30.668288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:30.669179 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:30.669494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:30.669768 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] PATH_INFO: `/v3/users/efca4c8f83e7487cb44db309b7499514` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:30.670940 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=efca4c8f83e7487cb44db309b7499514)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:30.672842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:30.865019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efca4c8f83e7487cb44db309b7499514'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:30.865019 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efca4c8f83e7487cb44db309b7499514'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:30.875985 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efca4c8f83e7487cb44db309b7499514'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:30.962958 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efca4c8f83e7487cb44db309b7499514'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:30.963596 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efca4c8f83e7487cb44db309b7499514'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:30.979288 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1417/2847] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:53:30 2022] DELETE /identity/v3/users/efca4c8f83e7487cb44db309b7499514 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:31.220858 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:31.232580 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d6402-0d56-44c8-a8b8-26d968d892dd service placement] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:31.297853 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:31.298719 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:31.299052 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:31.299332 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] PATH_INFO: `/v3/projects/bd2996e17c38425096392a2caf4cec28` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:31.300506 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2996e17c38425096392a2caf4cec28)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:31.302495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:31.423291 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2996e17c38425096392a2caf4cec28', 'request_id': 'req-652f8913-b796-4e88-8df2-8189c6983eba'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.429996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2996e17c38425096392a2caf4cec28', 'request_id': 'req-652f8913-b796-4e88-8df2-8189c6983eba'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.435946 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2996e17c38425096392a2caf4cec28', 'request_id': 'req-652f8913-b796-4e88-8df2-8189c6983eba'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.534389 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] The token cache is being invalidate because project bd2996e17c38425096392a2caf4cec28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:53:31.534680 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.539512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.539512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1431/2848] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:53:31 2022] DELETE /identity/v3/projects/bd2996e17c38425096392a2caf4cec28 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:31.541299 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:31.542705 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:31.556167 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faedde08-fd38-4ba0-b4d7-4d97d6a3aa4c admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:31.611106 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:31.611970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:31.612253 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:31.612528 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] PATH_INFO: `/v3/users/ed90f66dfb7647e79630dfc10c90e0a0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:31.613732 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed90f66dfb7647e79630dfc10c90e0a0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:31.615636 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:31.637532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:31.856760 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed90f66dfb7647e79630dfc10c90e0a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.857591 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed90f66dfb7647e79630dfc10c90e0a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.870170 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed90f66dfb7647e79630dfc10c90e0a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.943258 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed90f66dfb7647e79630dfc10c90e0a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.943872 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f5ba83e8-553b-4049-89bb-2bd5d7874de5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed90f66dfb7647e79630dfc10c90e0a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:31.956193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1418/2849] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:53:31 2022] DELETE /identity/v3/users/ed90f66dfb7647e79630dfc10c90e0a0 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:32.267883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:32.270084 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:32.283632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f8913-b796-4e88-8df2-8189c6983eba admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:32.303500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:32.341652 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:32.342513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.342793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.343061 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] PATH_INFO: `/v3/projects/80b9cdd611f347ef8b565dd6137136e2` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.344244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80b9cdd611f347ef8b565dd6137136e2)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:32.346483 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:32.461507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80b9cdd611f347ef8b565dd6137136e2', 'request_id': 'req-dfa30453-29b2-4421-8985-a1c9da24df78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:32.468427 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80b9cdd611f347ef8b565dd6137136e2', 'request_id': 'req-dfa30453-29b2-4421-8985-a1c9da24df78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:32.474081 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80b9cdd611f347ef8b565dd6137136e2', 'request_id': 'req-dfa30453-29b2-4421-8985-a1c9da24df78'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:32.537730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] The token cache is being invalidate because project 80b9cdd611f347ef8b565dd6137136e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:53:32.538022 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:32.538640 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-dfa30453-29b2-4421-8985-a1c9da24df78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:32.540302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1432/2850] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:53:32 2022] DELETE /identity/v3/projects/80b9cdd611f347ef8b565dd6137136e2 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:32.545322 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.545663 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.545933 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.563875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:32.565076 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:32.623902 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1419/2851] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:32.678812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.679106 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.679388 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.698303 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:32.699513 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:32.707391 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1433/2852] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:32.711581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:32.722446 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7ce75-d360-4083-9928-290e958b3cf9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:32.727029 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:32.727893 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.728169 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.728443 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.729193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:53:32.729533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:32.731138 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:32.742352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1420/2853] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:53:32.747016 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:32.756142 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b8ea6-d532-4044-a87b-42a089577b83 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:32.761404 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:32.762047 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.762331 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.762600 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.763296 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:32.765215 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:32.848053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1434/2854] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:53:32 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:53:32.852947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:32.863226 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37767e-8d50-40b5-b6aa-b1ac541fa134 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:32.917904 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:32.918561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:32.918844 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:32.919150 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:32.919822 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:32.921735 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:33.060432 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1421/2855] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:53:32 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:53:33.064544 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:33.075100 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227070fe-076a-45b1-a08d-e9ff23ad6572 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:33.079849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:33.080507 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:33.080793 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:33.081073 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:33.081906 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:33.083502 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:33.096127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1435/2856] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:53:33.100384 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:33.111230 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2aef1-7515-4663-a93e-469eae737501 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:33.115882 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:33.116570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:33.116862 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:33.117143 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:33.117908 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:33.119576 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfd5bd-ff19-45f8-b932-f816f2d2281a admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:33.129784 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1422/2857] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:53:33.133832 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:33.145442 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234f41c-a25b-4acc-8b03-cacfd6c07596 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:33.149991 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:33.151532 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:33.151913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:33.152196 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] PATH_INFO: `/v3/projects/d322bc4ba3094e468c704cf613fb04a2/users/210e83cdddb94a6aa4d8344d349954a0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:33.166601 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d322bc4ba3094e468c704cf613fb04a2, user_id=210e83cdddb94a6aa4d8344d349954a0, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:33.169378 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:33.237381 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1436/2858] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:53:33 2022] PUT /identity/v3/projects/d322bc4ba3094e468c704cf613fb04a2/users/210e83cdddb94a6aa4d8344d349954a0/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:33.247229 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:33.247517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:33.247871 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:33.254625 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:33.274334 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] MFA Rules not processed for user `210e83cdddb94a6aa4d8344d349954a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:33.276220 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:33.339646 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1423/2859] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:33.351620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:33.353320 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:33.406292 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:33.432413 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d6e1a-0e13-4556-8850-cbcf5b30eb6b admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:33.436211 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:33.436844 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:33.437127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:33.437434 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:33.445968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:33.448715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b34d3-2c18-4af4-9acb-394f5029991b service glance] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:33.457840 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1437/2860] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:53:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:53:43.377995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=30 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:43.509165 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=14 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:48.458715 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:48.520091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4525758-0f6a-4132-b64c-4be0fdbfc9b0 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:48.524679 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:48.525868 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:48.526533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:48.526533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] PATH_INFO: `/v3/users/210e83cdddb94a6aa4d8344d349954a0` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:48.527604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] RBAC: Authorizing `identity:delete_user(user_id=210e83cdddb94a6aa4d8344d349954a0)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:48.529570 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:48.710031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '210e83cdddb94a6aa4d8344d349954a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:48.710699 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '210e83cdddb94a6aa4d8344d349954a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:48.723780 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '210e83cdddb94a6aa4d8344d349954a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:48.791071 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '210e83cdddb94a6aa4d8344d349954a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:48.791684 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '210e83cdddb94a6aa4d8344d349954a0'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:48.804232 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1424/2861] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:53:48 2022] DELETE /identity/v3/users/210e83cdddb94a6aa4d8344d349954a0 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:48.808806 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:48.809309 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:48.809432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:48.826034 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:48.827834 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:48.885369 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1438/2862] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:48.895410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:48.896849 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:48.955686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f5a15-2f46-4180-9808-d97a288b2fac admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:48.959351 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:48.959995 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:48.960335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:48.960566 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:48.970456 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:48.971907 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8805637-3b55-4fe3-b7c4-895bcda587e3 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:48.981191 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1425/2863] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:53:49.404012 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:49.406120 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:49.422344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae063e48-ca83-40a7-9f23-17932fccd151 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:49.423194 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:49.424999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.425308 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.425589 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] PATH_INFO: `/v3/projects/d322bc4ba3094e468c704cf613fb04a2` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.427037 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d322bc4ba3094e468c704cf613fb04a2)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:49.428881 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:49.532932 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd322bc4ba3094e468c704cf613fb04a2', 'request_id': 'req-777c6c3c-e61a-4c08-a31d-45c825f460c3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:49.539364 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd322bc4ba3094e468c704cf613fb04a2', 'request_id': 'req-777c6c3c-e61a-4c08-a31d-45c825f460c3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:49.544873 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd322bc4ba3094e468c704cf613fb04a2', 'request_id': 'req-777c6c3c-e61a-4c08-a31d-45c825f460c3'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:49.645588 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] The token cache is being invalidate because project d322bc4ba3094e468c704cf613fb04a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:53:49.645883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:49.646509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-777c6c3c-e61a-4c08-a31d-45c825f460c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:53:49.648060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1439/2864] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:53:49 2022] DELETE /identity/v3/projects/d322bc4ba3094e468c704cf613fb04a2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:49.652858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.653357 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.656552 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.673059 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:49.674291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:49.691674 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:49.734491 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1426/2865] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:49.742219 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.742512 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.742790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.761695 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:49.762895 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:49.771480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1440/2866] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:49.775683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:49.786162 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c95459-5243-4e4c-84d7-2f5e917d651d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:49.790623 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:49.791268 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.791546 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.791817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.792533 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:53:49.792837 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:49.794451 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:49.806360 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1427/2867] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:53:49.810451 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:49.820371 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2057b-ea79-4529-b32b-5504b9b5f362 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:49.825023 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:49.825704 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.825992 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.826270 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.826955 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:49.828835 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:49.900971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1441/2868] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:53:49 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:53:49.905512 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:49.915387 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c258676-0aca-4445-a71f-ca66415a0550 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:49.978918 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:49.979592 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:49.979875 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:49.980152 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:49.980841 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:49.983410 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:50.057856 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1428/2869] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:53:49 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:53:50.061982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:50.072217 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fef589-901e-46af-8183-2446d95bd591 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:50.076935 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:50.077620 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:50.077911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:50.078180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:50.078896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:50.080495 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:50.090819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1442/2870] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:53:50.095464 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:50.105342 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f6e88-c4da-4558-9e46-2eb879a5c5ea admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:50.110717 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:50.111373 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:50.111660 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:50.111938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:50.112686 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:50.114317 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c806219-837d-4043-baab-27110fa6236c admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:50.124343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1429/2871] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:53:50.128647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:50.138668 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350da94-6c01-452b-9640-ab857e13c45e admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:50.143562 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:50.144487 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:50.144774 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:50.145054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] PATH_INFO: `/v3/projects/948756a5f2634f5198a3ac8f1d45a303/users/a46a213ca4ac48beb1fe5b1dd9679c9b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:50.160051 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948756a5f2634f5198a3ac8f1d45a303, user_id=a46a213ca4ac48beb1fe5b1dd9679c9b, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:50.162795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:50.231632 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1443/2872] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:53:50 2022] PUT /identity/v3/projects/948756a5f2634f5198a3ac8f1d45a303/users/a46a213ca4ac48beb1fe5b1dd9679c9b/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:53:50.244218 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:50.244555 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:50.244838 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:50.272521 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] MFA Rules not processed for user `a46a213ca4ac48beb1fe5b1dd9679c9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:53:50.273823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:50.339355 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1430/2873] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:53:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:53:50.351500 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:53:50.353244 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:53:50.375302 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:53:50.411792 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa0693-9029-432b-b88c-88c5abb83769 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:53:50.415431 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:53:50.416070 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:53:50.416351 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:53:50.416626 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:53:50.424960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:53:50.426414 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252ce85-b5a6-428b-9a7c-cba7121bd55b service glance] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:53:50.434940 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1444/2874] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:53:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:00.336465 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:00.488829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=17 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:15.193746 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:15.256386 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e0ffcb-61fd-421c-85e2-9ade939a430d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:15.260821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:15.261714 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:15.262003 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:15.262282 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] PATH_INFO: `/v3/users/a46a213ca4ac48beb1fe5b1dd9679c9b` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:15.263448 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a46a213ca4ac48beb1fe5b1dd9679c9b)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:15.265395 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:15.469859 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a46a213ca4ac48beb1fe5b1dd9679c9b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:15.470709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a46a213ca4ac48beb1fe5b1dd9679c9b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:15.482774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a46a213ca4ac48beb1fe5b1dd9679c9b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:15.539708 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a46a213ca4ac48beb1fe5b1dd9679c9b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:15.542092 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a46a213ca4ac48beb1fe5b1dd9679c9b'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:15.554031 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1431/2875] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:54:15 2022] DELETE /identity/v3/users/a46a213ca4ac48beb1fe5b1dd9679c9b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:15.558489 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:15.558987 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:15.559112 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:15.576645 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:15.577923 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:15.636960 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1445/2876] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:15.650263 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:15.651737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:15.709089 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282468e-28b7-464b-8bb9-11ccaeb5616d admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:15.712666 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:15.713336 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:15.713628 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:15.714000 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:15.723711 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:15.725058 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904ea39-f996-41c1-b6f8-0393889eb0b4 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:15.734494 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1432/2877] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:16.152890 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.154459 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:16.167282 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d12b7-618f-4965-9c24-4424b3530396 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.171999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.172841 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.173128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.173455 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] PATH_INFO: `/v3/projects/948756a5f2634f5198a3ac8f1d45a303` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.174762 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=948756a5f2634f5198a3ac8f1d45a303)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.177003 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.309328 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948756a5f2634f5198a3ac8f1d45a303', 'request_id': 'req-b3f04ee8-a098-4832-8aef-421a93ace2ae'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:16.315971 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948756a5f2634f5198a3ac8f1d45a303', 'request_id': 'req-b3f04ee8-a098-4832-8aef-421a93ace2ae'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:16.322718 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948756a5f2634f5198a3ac8f1d45a303', 'request_id': 'req-b3f04ee8-a098-4832-8aef-421a93ace2ae'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:16.390930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] The token cache is being invalidate because project 948756a5f2634f5198a3ac8f1d45a303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:54:16.391280 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:16.391849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-b3f04ee8-a098-4832-8aef-421a93ace2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:16.393593 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1446/2878] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:54:16 2022] DELETE /identity/v3/projects/948756a5f2634f5198a3ac8f1d45a303 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:16.399281 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.399820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.399820 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.418303 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:16.419574 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:16.437422 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:16.483463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1433/2879] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:16.491424 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.491715 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.491999 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.511763 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:16.512962 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:16.521582 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1447/2880] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:16.525813 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.535635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255088-eb3a-4e07-924d-8dc5879e9151 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.540947 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.541656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.541942 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.542221 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.542951 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:54:16.543264 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.544858 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.556537 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1434/2881] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 03:54:16.560875 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.570614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d9238-d781-4d36-b252-ca6d57911a36 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.575229 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.579014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.579014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.579014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.579014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.579014 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.675060 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1448/2882] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:54:16 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:54:16.684827 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.695608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87480608-fe0e-40b3-8141-cc772a88a204 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.750608 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.751274 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.751561 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.751842 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.752531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.754463 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.842898 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1435/2883] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:54:16 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:54:16.847233 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.857635 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712d238-b3b8-46c9-9c35-af987d494da9 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.862220 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.865412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.865412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.865412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.865412 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.866362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.876190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1449/2884] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:54:16.880805 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.890869 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e301eb-c157-4c56-acfc-fab30dd34e25 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.895577 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.896231 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.896517 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.896797 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.897549 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.899124 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f78a8d-caa1-4e9a-a4d4-b7bda4b64005 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:16.908861 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1436/2885] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:54:16.913143 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:16.922920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3c3bf-7161-4f2e-9fe1-72c28b25fb57 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:16.928004 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:16.928874 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:16.929153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:16.929456 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] PATH_INFO: `/v3/projects/d64b8d2fc6fd4ee9be4d3d82601d0c99/users/d4ec72b9bcf24220958a34c5d92fcb8a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:16.944228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64b8d2fc6fd4ee9be4d3d82601d0c99, user_id=d4ec72b9bcf24220958a34c5d92fcb8a, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:16.946896 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:17.024920 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1450/2886] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:54:16 2022] PUT /identity/v3/projects/d64b8d2fc6fd4ee9be4d3d82601d0c99/users/d4ec72b9bcf24220958a34c5d92fcb8a/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:17.036323 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:17.042581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:17.042581 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:17.064519 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] MFA Rules not processed for user `d4ec72b9bcf24220958a34c5d92fcb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:17.065758 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:17.130116 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1437/2887] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:17.141720 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:17.143387 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:17.157078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:17.201590 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8075a4-b972-437b-81e8-3dfeed2ef779 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:17.205277 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:17.205925 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:17.206213 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:17.206490 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:17.215007 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:17.216951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158f5e7-555a-4cad-be32-e01d1bc33032 service glance] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:17.227344 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1451/2888] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:27.127084 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:27.245239 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=21 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:40.240364 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:40.302640 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff339846-53d0-4fcc-8403-178fb641c877 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:40.307335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:40.309348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:40.309348 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:40.309584 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] PATH_INFO: `/v3/users/d4ec72b9bcf24220958a34c5d92fcb8a` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:40.310741 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4ec72b9bcf24220958a34c5d92fcb8a)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:40.312645 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:40.529630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4ec72b9bcf24220958a34c5d92fcb8a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:40.530277 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4ec72b9bcf24220958a34c5d92fcb8a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:40.542562 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4ec72b9bcf24220958a34c5d92fcb8a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:40.610326 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4ec72b9bcf24220958a34c5d92fcb8a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:40.610950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4ec72b9bcf24220958a34c5d92fcb8a'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:40.624145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1438/2889] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:54:40 2022] DELETE /identity/v3/users/d4ec72b9bcf24220958a34c5d92fcb8a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:40.628659 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:40.629162 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:40.629301 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:40.645948 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:40.647136 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:40.704710 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1452/2890] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:40.714233 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:40.715833 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:40.773103 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70ecaa-83cf-43ec-bb76-0dc319e741e9 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:40.776796 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:40.777445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:40.777823 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:40.778293 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:40.787225 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:40.788638 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bca977-282b-46ec-bc1b-54da4b28bde2 service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:40.798424 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1439/2891] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:41.183204 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.184768 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:41.199432 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e06520-c1a1-478d-acd4-3a398f6f0956 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.204594 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.209147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.209147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.209147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] PATH_INFO: `/v3/projects/d64b8d2fc6fd4ee9be4d3d82601d0c99` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.209147 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64b8d2fc6fd4ee9be4d3d82601d0c99)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.209930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.336619 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64b8d2fc6fd4ee9be4d3d82601d0c99', 'request_id': 'req-ed6be419-1fb4-4104-8347-692de1e86360'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:41.343569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64b8d2fc6fd4ee9be4d3d82601d0c99', 'request_id': 'req-ed6be419-1fb4-4104-8347-692de1e86360'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:41.349494 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64b8d2fc6fd4ee9be4d3d82601d0c99', 'request_id': 'req-ed6be419-1fb4-4104-8347-692de1e86360'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:41.426771 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] The token cache is being invalidate because project d64b8d2fc6fd4ee9be4d3d82601d0c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80541) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:54:41.427053 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:41.427660 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-ed6be419-1fb4-4104-8347-692de1e86360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:54:41.429180 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1453/2892] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:54:41 2022] DELETE /identity/v3/projects/d64b8d2fc6fd4ee9be4d3d82601d0c99 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:41.434213 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.434676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.434836 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.453045 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:41.454261 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:41.471578 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:41.513979 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1440/2893] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:41.521692 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.521982 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.522297 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.541355 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:41.542609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:41.550566 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1454/2894] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:54:41.554709 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.564321 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72750c7-44db-48ee-9313-1ec0d2aede4d None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.568821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.569490 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.569774 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.570062 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.570759 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 03:54:41.571125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.572692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.584795 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1441/2895] 10.222.0.71 () {58 vars in 1152 bytes} [Fri May 27 03:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 03:54:41.588949 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.599021 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84accff0-458d-4fda-9860-0f7add060bd2 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.603714 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.604362 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.604647 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.604926 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] PATH_INFO: `/v3/projects` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.605721 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.607677 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.689126 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1455/2896] 10.222.0.71 () {60 vars in 1152 bytes} [Fri May 27 03:54:41 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:54:41.693171 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.703905 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f808e-5779-4cd4-8093-98bc592d14f2 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.760090 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.760755 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.761041 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.761356 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.762698 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.764613 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.864689 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1442/2897] 10.222.0.71 () {60 vars in 1143 bytes} [Fri May 27 03:54:41 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 03:54:41.868878 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.880394 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50305f34-c26f-4223-9f07-3fb65661717a admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.885046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.885795 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.890195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.890195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] PATH_INFO: `/v3/roles` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.890195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.890195 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.900128 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1456/2898] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 03:54:41.904055 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.913966 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3a34f-b131-45e9-82c2-d483f815c7c5 admin admin] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.918598 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.919249 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.919535 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.919832 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] PATH_INFO: `/v3/roles` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.920531 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.922151 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155c73e-213b-4bf4-bb14-4f802be0933b admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:41.931926 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1443/2899] 10.222.0.71 () {58 vars in 1121 bytes} [Fri May 27 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 03:54:41.936910 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:41.948127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797f848-d89f-4355-8eeb-7e1cb1a898da admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:41.953769 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:41.954644 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:41.954928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:41.955208 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] PATH_INFO: `/v3/projects/8a9f3c2a07b64f9586a82a1e594a5e47/users/6899143c2dbd4b6bbc00c7f10a4db191/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:41.969819 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9f3c2a07b64f9586a82a1e594a5e47, user_id=6899143c2dbd4b6bbc00c7f10a4db191, role_id=a0e38cd92e294a4fb8fc8a2b4451cb6c)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:41.972775 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:42.051036 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1457/2900] 10.222.0.71 () {60 vars in 1482 bytes} [Fri May 27 03:54:41 2022] PUT /identity/v3/projects/8a9f3c2a07b64f9586a82a1e594a5e47/users/6899143c2dbd4b6bbc00c7f10a4db191/roles/a0e38cd92e294a4fb8fc8a2b4451cb6c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:54:42.061970 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194614e-2d73-4116-8dd1-3a5abef2e544 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:42.064125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194614e-2d73-4116-8dd1-3a5abef2e544 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:42.064125 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194614e-2d73-4116-8dd1-3a5abef2e544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:42.088343 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-f194614e-2d73-4116-8dd1-3a5abef2e544 None None] MFA Rules not processed for user `6899143c2dbd4b6bbc00c7f10a4db191`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:42.089630 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f194614e-2d73-4116-8dd1-3a5abef2e544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:42.153070 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1444/2901] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:42.164883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:42.166597 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:42.190046 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:42.225156 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989a06d-3ab6-449b-915e-e674ae75c8a8 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:42.229193 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b23f15e3a064cd7b7cb6c100004a111', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:42.229867 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:42.230154 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:42.230439 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:42.239319 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:42.240812 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:42.250541 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1458/2902] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:44.065673 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:44.066174 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:44.066294 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:44.083692 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] MFA Rules not processed for user `6899143c2dbd4b6bbc00c7f10a4db191`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:54:44.084897 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:44.092527 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1445/2903] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:54:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:54:44.128354 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:44.132105 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:44.187959 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc31c4-574b-4c30-9d85-9fc9ee004f03 service cinder] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:44.191828 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ce376ecc47a48c1bac3a5231d09c91c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:44.192473 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:44.192758 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:44.193078 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:44.194928 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:44.267245 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:44.268609 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:44.280523 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1459/2904] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:45.795504 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:45.796938 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:45.805321 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:45.806711 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:45.810950 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:45.867465 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1b651-a7ac-4e62-a424-b6dbc231fbee service glance] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:45.867975 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465a98-5dea-4e19-8480-5a557755c7c1 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:45.871228 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:45.871868 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:45.872293 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:45.872709 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:45.873113 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:45.873821 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:45.874108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:45.874389 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:45.874522 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:45.876159 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:45.888673 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:45.888857 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:45.890441 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:45.895569 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:45.900505 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1446/2905] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:45.902552 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1460/2906] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 03:54:49.174615 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:49.176065 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:49.190816 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09362a40-3c26-40bd-a525-9aac02d98182 service placement] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:49.194538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:49.195185 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:49.195466 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:49.195737 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:49.197534 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:49.211471 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:49.212952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:49.229516 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1447/2907] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:50.292267 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:50.294269 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:50.313790 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94f62-9cdb-4655-9655-2c0f39246273 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:50.319572 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:50.320225 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:50.320511 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:50.320787 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:50.322625 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:50.332646 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=100 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:54:50.337192 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:50.338849 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91dbec5-aa3e-4ca0-b88c-2a33a3cba321 service nova] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:50.351138 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1461/2908] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:54:56.514906 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:54:56.516445 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:56.532961 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592c131-11ef-4c35-b98c-9e95333b4f6a service neutron] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:54:56.538597 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17726b67d4d54d38be845acf03cbb664', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:54:56.539246 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:54:56.539532 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:54:56.539810 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:54:56.541604 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:54:56.554817 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:54:56.556418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:54:56.568177 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1448/2909] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:55:00.421931 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=3 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:55:02.826886 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a64f-e40e-454f-bae2-e70966247392 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:02.827445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a64f-e40e-454f-bae2-e70966247392 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:02.827445 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a64f-e40e-454f-bae2-e70966247392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:02.884390 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-1ec0a64f-e40e-454f-bae2-e70966247392 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:55:02.885614 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-1ec0a64f-e40e-454f-bae2-e70966247392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:02.949011 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1462/2910] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:55:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:55:03.105835 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:03.107307 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:03.196772 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67b1f2-ce1a-475d-a36c-4f943d1c9e36 service nova] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:03.202588 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:03.203335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:03.203683 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:03.204036 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:03.212066 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:03.213671 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:03.222582 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1449/2911] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:55:04.116054 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447076-d265-47fe-8565-822728a6d54b None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:04.116550 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447076-d265-47fe-8565-822728a6d54b None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:04.116706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be447076-d265-47fe-8565-822728a6d54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:04.135706 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-be447076-d265-47fe-8565-822728a6d54b None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:55:04.136968 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-be447076-d265-47fe-8565-822728a6d54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:04.144399 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1463/2912] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:55:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:55:04.157094 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:04.167779 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf3f52-bdfc-438b-bdf6-5307b110f86e service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:04.173626 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:04.174352 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:04.174635 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:04.174912 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:04.183095 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:04.184659 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:04.192891 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1450/2913] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:55:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:55:05.018942 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40df2e-bd52-40cc-b72d-b686b6ba503d None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:05.019230 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40df2e-bd52-40cc-b72d-b686b6ba503d None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:05.019509 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40df2e-bd52-40cc-b72d-b686b6ba503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:05.037951 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-0e40df2e-bd52-40cc-b72d-b686b6ba503d None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:55:05.039148 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-0e40df2e-bd52-40cc-b72d-b686b6ba503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:05.046871 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1464/2914] 10.222.0.71 () {58 vars in 1009 bytes} [Fri May 27 03:55:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:55:05.058513 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:05.069468 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a43b7-27fb-404f-b321-46a1acf06f4e service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:05.074458 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:05.075091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:05.075377 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:05.075653 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:05.084291 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:05.085988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:05.097972 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1451/2915] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:55:05.714921 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] REQUEST_METHOD: `POST` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:05.715385 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:05.715486 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:05.733730 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.auth.core [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] MFA Rules not processed for user `e9a0738758e145e28f087b36ded06e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80541) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:55:05.734930 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:05.741956 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1465/2916] 10.222.0.71 () {58 vars in 967 bytes} [Fri May 27 03:55:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 03:55:05.755108 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:05.766362 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93146407-2bc3-4c73-bd9b-86b8e2dea969 service swift] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:05.771241 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcd9230db6ae4c46b4cfb0e07a103949', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:05.771863 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] REQUEST_METHOD: `GET` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:05.772193 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:05.772418 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:05.780269 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:05.781870 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984381-4a2e-4f2d-a92e-fb0e4e81dc6e service swift] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:05.789749 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1452/2917] 10.222.0.71 () {60 vars in 1384 bytes} [Fri May 27 03:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 03:55:08.423591 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:08.485276 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a3ac3-d6d9-4762-963c-5f4708efae34 None None] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:08.489767 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:08.490631 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:08.490913 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:08.491190 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] PATH_INFO: `/v3/users/6899143c2dbd4b6bbc00c7f10a4db191` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:08.492373 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6899143c2dbd4b6bbc00c7f10a4db191)` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:08.494375 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:08.678744 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:55:08.680259 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6899143c2dbd4b6bbc00c7f10a4db191'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:08.692403 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6899143c2dbd4b6bbc00c7f10a4db191'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:08.786883 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6899143c2dbd4b6bbc00c7f10a4db191'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:08.787525 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6899143c2dbd4b6bbc00c7f10a4db191'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:08.788141 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.notifications [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6899143c2dbd4b6bbc00c7f10a4db191'} {{(pid=80541) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:08.802526 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1466/2918] 10.222.0.71 () {58 vars in 1223 bytes} [Fri May 27 03:55:08 2022] DELETE /identity/v3/users/6899143c2dbd4b6bbc00c7f10a4db191 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:55:08.807145 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] REQUEST_METHOD: `POST` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:08.807651 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:08.807757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:08.815187 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=100 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:55:08.825606 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.auth.core [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] MFA Rules not processed for user `52217d6a62f34512804d80cd8e1d71d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 03:55:08.832082 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:08.884404 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1453/2919] 10.222.0.71 () {58 vars in 957 bytes} [Fri May 27 03:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 03:55:08.894538 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:08.896085 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:08.954996 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc9d2f-fe74-4f2c-9b42-1628c57a5aa1 admin admin] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:08.958616 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4c5841ec0bd4e16b90e6b1c42ff0df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:08.959260 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:08.959548 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:08.959829 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:08.969166 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:08.970891 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:08.980343 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1467/2920] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:55:09.225894 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] Authenticating user token {{(pid=80540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:55:09.227335 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.fernet_utils [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:55:09.241757 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d296c-b697-4784-a41a-aeec612865c9 None None] Validating token access rules against request {{(pid=80540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:55:09.246676 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '52217d6a62f34512804d80cd8e1d71d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '924e7efee14f4da6a43ace55813683f0', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:55:09.247538 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:55:09.247819 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:55:09.248091 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] PATH_INFO: `/v3/projects/8a9f3c2a07b64f9586a82a1e594a5e47` {{(pid=80540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:55:09.250046 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9f3c2a07b64f9586a82a1e594a5e47)` {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:55:09.251952 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] RBAC: Authorization granted {{(pid=80540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:55:09.384656 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9f3c2a07b64f9586a82a1e594a5e47', 'request_id': 'req-716dd617-81bb-448e-9e4a-b2a4127cc26f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:09.390953 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9f3c2a07b64f9586a82a1e594a5e47', 'request_id': 'req-716dd617-81bb-448e-9e4a-b2a4127cc26f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:09.396853 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9f3c2a07b64f9586a82a1e594a5e47', 'request_id': 'req-716dd617-81bb-448e-9e4a-b2a4127cc26f'} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:09.490431 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] The token cache is being invalidate because project 8a9f3c2a07b64f9586a82a1e594a5e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 03:55:09.490652 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:09.491287 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG keystone.notifications [None req-716dd617-81bb-448e-9e4a-b2a4127cc26f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 03:55:09.492839 dv-cinder-843361-2-smb devstack@keystone.service[80540]: [pid: 80540|app: 0|req: 1454/2921] 10.222.0.71 () {58 vars in 1232 bytes} [Fri May 27 03:55:09 2022] DELETE /identity/v3/projects/8a9f3c2a07b64f9586a82a1e594a5e47 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 03:55:18.976127 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=39,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:55:19.486988 dv-cinder-843361-2-smb devstack@keystone.service[80540]: DEBUG dbcounter [-] [80540] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 03:56:19.448922 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] Authenticating user token {{(pid=80541) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 03:56:19.450533 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:56:19.520911 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501e114-3c3b-4b13-a325-d3f9f349d261 service neutron] Validating token access rules against request {{(pid=80541) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 03:56:19.581153 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f25676e7b2c74e65b86b758cfdccf216', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '194b0ced8c1a40bf970740516d7c1702', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80541) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 03:56:19.581831 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] REQUEST_METHOD: `GET` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 03:56:19.582116 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] SCRIPT_NAME: `/identity` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 03:56:19.582396 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80541) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 03:56:19.584274 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.fernet_utils [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80541) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 03:56:19.596349 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 03:56:19.597964 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391544b9-9de3-43da-acd5-254603b2f4ef service placement] RBAC: Authorization granted {{(pid=80541) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 03:56:19.607945 dv-cinder-843361-2-smb devstack@keystone.service[80541]: [pid: 80541|app: 0|req: 1468/2922] 10.222.0.71 () {60 vars in 1365 bytes} [Fri May 27 03:56:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 03:56:29.603480 dv-cinder-843361-2-smb devstack@keystone.service[80541]: DEBUG dbcounter [-] [80541] Writing DB stats keystone:SELECT=58 {{(pid=80541) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}